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~ «I, INTRODUCTION 

This thesis is intended for human factors engineers who 
seek additional technigues to use in evaluating the adequacy 
of new systems. The technigues discussed here are commonly 
used in the field of operations research. They are readily 
applicable to many human factors problems, but are not 
widely known in that discipline. Most of these technigues 
result in quantitative answers--numbers or eguations which 
represent how much money or time will be saved, oor how Many 
errors can Le expected, etc., if this particular system or 
change is implemented. 

Human factors engineers certainly recognize the need for 
humerical answers to engineering problems, based on measures 
of effectiveness. The deSign and systems engineers who 
oversee major programs are justifiably skeptical of qualita- 
tive judgements--especially ones like, "It is my informed 
opinion that the operator will make fewer errors if we raise 
the widget 2 inches." Since it costs money to change a 
design and raise a widget, at least three questions need to 
be asked. How much does an error cost? By how much will 
errors be reduced? In the long run, will it be cost efiec- 
tive (in money or lives), if we raise the widget? 

Numerical answers may be available, in specific cases, 
as a result of directly-applicable experimentation (either 
previously carried out or done especially to answer a 
current question). Usually, however, they are not. When 
empirical data are not available, the human factors engineer 
must rely either on intuition or on extrapolation of what is 
known, through the use of some model, to make evaluations. 
The operations research techniques presented here are 


intended to assist in the latter process. 


A. BACKGROUND 


For some time, human factors engineers have been 


intrigued by a possible liaison of human factors with opera- 


tions research, notes DeGreene [Ref. 1]. However, he 
continues, human factors and operations research have 
largely gone their Separate ways. The rormer perhaps have 


made somewhat more use of operations research techniques 
than the latter have -incorporated psychological knowledge 
from human factors research. Still, much of the mathematics 
and many of the concepts used in operations research remain 
outside the general knowledge pool of human factors 
specialists. 

peGreene describes the gap between the two disciplines 


as follows: 


Operations research tends to be formal and guanta- 
tive, and a eee at the subsystem level, or lower, and 
toward suboptimizations, in the systems sense, rather 
than towards optimizations. Toa Shoae extent, there is 
an emphasis on theory over applications. 


Yet in many._ways, opera: research represents .a 

natural extenSion of the methods long practiced in 

psychological and human factors research. . In both 

cases, problem. "fields" and . methodologies (e.g. 

Sampling, surveying and simulation) are Similar, an 
uantitative procedures have a basis in probability 
heory. 

Operations research tends, to require more mathe- 
matics. than most psychologists an human factors 
Speer etaee possess or need. We know of no texts, arti- 
cles, Or university courses entitled "Operations 
Research Techniques for. the Human Factors Specialist". 
Such courses would require a respectable understandin 
of human behavior, as well as mathematica 
manipulations. 


DeGreene does acknowledge a number of human factors 
problems that actually have utilized operations research 
techniques. These include panel layout; work space design; 
visual sampling and display design; information system data- 
file, data-bank, and data retrieval designs; organizational 


data flows; and manpower determinations and allocations. 


10 


However, he notes that a large number of potentially useful 
techniques are not widely used. He lists queueing theory, 
linear programming, and game theory as eSpecially fruitful 
areas for human factors applications. 

This study is intended as a slender bridg2 across the 
gap DeGreene has described. It may be useful to operations 
researchers who happen to work with man-machine systems. 
However, the primary intended audience consists of human 


factors engineers. Specific operations research techniques 
are identified and described here, then correlated with 
human factors-related problems. Thus, human factors engi- 


heers may be able to pick up some of these procedures, as 
applicable to their individual areas of interest, without 
having to study the whole of operations research. 

According to Cogan [Ref. 2], good operations research 
and good human factors have several points in common. Both 
are concerned with how to implement innovations. And both 
require a general imagination, elastic feats of the mind, 
and adventurousness. Effective work in both fields must be 
based on an intimate knowledge of the system being studied. 
Discovery, invention, or creativity puts this knowledge in a 
new ligit. A formal epistemological or mathematical review 
then provides a firm foundation for inovation. 

While human factors principles are appliei (or can be 
applied) throughout the whole range of human activities, one 
of the most promising areas for the melding of that disci- 


pline with operations research is in military systems. The 
enormous expense of these systems, coupled with the severe 
consequences of human error, Suggest that all applicable 


technigues that might result in system improvements should 
be utilized. Therefore, military applications are 
emphasized in the examples given below. 

To aid in understanding the techniques presented here, 


it is useful to provide a common thread throughout the 
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explanations and examples. AgeUa l Livy, two "threads" are 
used. The first is the employment of a constant format in 
describing all of the techniques (as discussed in the next 
chapter). The second is the application of each technique 


to the same (or close to the same) Scenario or mission. The 


Navy's mission area of antiair warfare (AAW) has been 
selected for this purpose. Insofar as practical, that 
tactical category known as air combat maneuvering 


(ACM)--direct air battles between two or more fighter 
aircraft--is used to illustrate how the various operations 


research techniques may be applied. 


Be OBJECTIVES AND PROCEDURE 


The objectives of this study are: 

1. To identify and classify a number of operations 
research models and technigues which are applicable 
to certain human factors problems. 

2. To describe several of these models and techniques in 
enough detail to enable the human factors engineer to 
determine if they are useful for his or her 
particular problems. 

3. To illustrate the use of some of these techniques in 
a military-related human factors setting. 

4. To provide references for additional information on 
each listed technique, to enable further study if the 
human factors engineer is interested. 

In short, this is intended as a "how to" manual, nota 
"why so" textbook. Readers who desire or need a theoretical 
basis for the technigues discussd here are referred to the 
more standard mathematics and operations research texts 


Cited in each section. 
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II. DEPINITIONS 

Before beginning discussion of operations research tech- 
higues applicable to human factors engineering problems, the 
following sections briefly describe what is meant fin this 
study) by the following terms: | 

1. Human factors and human factors engineering 

2. Systems engineering, systems analysis, and operations 

analysis 

3. Operations research 

4. Operations research technigues 
The procedure used in this study to combine human factors 
engineering problems with operations research techniques 


miso 3s discussed. 


Aw. HUMAN FACTORS ENGINEERING 


Human factors engineering is the application of informa- 
tion about human behavior in the design of equipment, facil- 
ities, and environments, in order to meet man-machine systen 
objectives. It 1S not synonymous with, but rather isa 
subset of, the more general field of human factors. The 
latter also includes research into human capabilities and 
the enhancement of capabilities through training, as well as 
application of research findings to design problems. 

Closely related to human factors engineering is the 
field of engineering. psychology. The difference is in 
focus. Human Factors engineering adopts the perspective of 
the engineer, and is concerned with the entire human bodv 
and its performance. Engineering psychology, on the other 
hand, adopts the perspective of the psychologist, and so 
focuses on the brain, the mind, and behavior. 
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According to McCormick and Sanders [Ref. 3], the primary 
focus of the general field of human factors is on human 


beings carrying out functions to meet an objective (or, as 


Bailey {[Ref. 4] puts it, "Somebody doing something some- 
place"=-that is, a person converting inputs to specified 
outputs, via work activities). The combination of person, 


activity, and surroundings--including equipment needed to 
perform the activity--can be considered a man-machine 
system, and thus is amenable to the techniques of systems 
analysis. 

The approach used in human factors engineering is the 
Systematic application of relevant information about human 
abilities, characteristics, behavior, and motivation, in the 
execution of Functions or activities as described above. In 
other words, engineering technigues and knowledge about the 
human being are applied to the man-machine system, to bring 
about some desired output from given inputs. In doing sey 
as Jones points out j[Ref. 5], the psychologist is well aware 
that the man 1s, at best, statistical in nature (while the 
typical systems engineer is only vaguely aware that human 
behavior is variable, nonlinear, and time varying). 

It is important to note that the human factors engineer 
attempts to apply research-based information (as opposed to 


logic or common sense) to systems problems, as is emphasized 


by Chapanis [Ref. 6j. He notes: 


Because psychologists work so ee with tne 
tangled skein oof relationships. which constitute human 
behavior, they are not much inclined to trust there 
Common sense, intuitions, or logical powers of analysis 
when it comes to matters of this kind. Most good human 
engineers, I find, are always a little uneasy when they 
have to make decisions unsupported by empirical find- 
Ings. To such peor one good experiment is worth a 
hundred guesses, ecause they know how often guesses 
turn out to be wrongss- 


As a result, _the two kinds of engineers--human and 
systems--do not often understand each other. The one is 
reluctant to play his hunches, and argues conse for 
empirical evidence; the other is impatient at the long- 
haired scientific attitude which demands validation, and 
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argues that an "informed guess" is better than none. In 
the long run, however he validity of any model must 
face the stern test of empirical validation. ine t has 
respect, the human engineer's scepticism can contribute 
to the work of the operations analyst. 


It also is important to note that Knowledge about human 
performance is unavailable, to cover every possible situ- 
ation and under all conditions. What we know--through human 
factors research--is how a typical or anticipated user prob- 
ably will perform in some previously-studied situations. 

Thus, when a new Situation arises (through developmeat 
of a new system) we usually have only two ways to "find out! 
how well we may expect the Mman-machine system to do its 
intended job. We can perform research and measure perforn- 
ance under the precise conditions of interest. Or we can 
take the closest, best data presently at hand and extend its 
usefulness (make predictions) through some form of analysis. 

The field of human factors engineering, and the measure- 
ment and analysis techniques used by that discipline to 
attack various problems, often are divided into established 
categories. It is useful for our purposes to classify these 
categories under the objectives for @which they are 
intended--objectives which then can be related to the opera- 
tions research techniques to be discussed here. These 
objectives may be stated as: 

1. Describing individual human differences: permanent 
differences, such as those that are inherent or due 
to experience, or transitory differences, such as 
those due to physical or emotional state, motivation, 
etc. | 

2. Describing a Man-machine systen. 

3. Designing (or modifying) a system for optimum 


performance. 


Par Sa 


4. Evaluating human performance within the system, to 


judge whether given criteria are met for such things 


AED 


aS perceiving inputs, performing mental activities 
(mediation), communicating, and making responses 
(motor processes). 

Table 1 illustrates how various "standard" human factors 
categories fit within these four general objectives. As 
noted, these objectives sometimes have been met by measuring 
attributes or performance, through tests and experiments. 
At other times, techniques of prediction have been used, via 
analysis and modeling. 

Those human factors engineering methods and procedures 
listed in Table 1 that have been extensively exploited in 
the past are not covered in this study. These include func- 
tion, task, timeline, workload, link, and environment anal- 
ysis, as well as’ the design, conduct, and analysis of 
experiments and tests. The intent here is to break new 
ground, not to review the entire spectrum of techniques. 
Similar human factors objectives often can be met, in sonme- 
what different ways (and sometimes with better results), 
using the less familiar operations research techniques 
discussed below. 


Be. SYSTEMS ANALYSIS AND OPERATIONS ANALYSIS 


Analysis, of course, is the separation of a whole into 
its component parts. Analysis can be looked upon as a 
detailed examination of anything complex, in order to under- 
stand the nature and to determine the essential features of 
that complex object or concept. 

A system can be considered an assemblage of constituents 
(people, hardware, and software) that interact to fulfill a 
common purpose, transcending the individual purposes of the 
components [Ref. 7]. Thus a system consists of several 
parts (each with attributes) plus the relationships among 


then. Often the inputs to and outputs from this collection 
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TABLE 1 
HUMAN FACTORS OBJECTIVES AND CATEGORIES 
HUMAN FACTORS OBJECTIVE HUMAN FACTORS carzcont| 


1. Describe Individual Differe 
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thropometric measures 
Physiological measures 
Intelligence tests 
Psychological tests 


level tests 
el tests 
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ical states 
tional states 
tivation measures 
tisfaction measures 


Functional analyses 
Task analyses 
Workload analyses 
Link analyses 
Environment analyses 


Meta Meed 1 OCat 10n 
Eguipment design 
Environment design 
Job design 
Personnel selection 
Training design 
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Mediation modeling 
Information processing 
DeciSion making 
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Communications measurement 


Nonverbal 


Motor Processes measurement 
Simple/discrete 
Complex/continuous 
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of objects also are considered part of the systen. Since, 
aS John Muir pointed out, “Everything in the universe seems 
to be hitched to everything else," systems (and systems 
problems) often are large and complex. Figure 2.1i1s a very 


Simple model of a man-machine system, uSing this definition. 


Figure 2.1 Simple Model of a Man-Machine Systen 
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Systems engineering is the application of stientific and 
engineering knowledge to the planning, design, evaluation, 
and construction of man-machine systems and system comnpo- 
nents, according to Chapanis {Ref. 8]. The process prima- 
rily is concerned with the construction of new hardware and 
software systems. Since the knowledge to be applied must 
include information about human behavior, human factors 
engineering may be considered a subcategory of systems 
engineering. 

Systems analysis is the process of taking unmanageably 
large problems of system design or control (especially prob- 
lems that are ill-defined) and "cutting" them into small 
problems--known as  suboptimization. Solutions to these 
small problems can be sought, then combined in Some manner 


to yield solutions for the large ones [Ref. 9]. 


When does a problem exist? According to Daellenbach and 
others [Ref. 10}, fora problem to exist, 

1. There must be a decision maker who has a goal to be 
achieved. 

2. At least two alternative courses of action are 
available. 

3. There must be some doubt about which is the best 
course of action. 

4. The problem must be treatable within a relevant 
environment. 

Operations analysis is the term usually applied to anal- 
yses of the operation of an existing system (as opposed to 
the design or development of a new system) [Ref. 11}. 
According to Raiffa [Ref. 12], problems tackled by opera- 
tions research are more limited in character than those of 
systems analysis, and have better defined structure and 
goals. There is no hard and fast demarcation line between 
the two, however. 

The basic role of operations analysis is to provide 
carefully reasoned, technical, and predictive advice to the 
System's users, according to DeGreene {[Ref. 13]. He lists 
as the sequential steps used for all operations analyses: 

1. Recognition that a problem exists and that the solu- 
tion may be amenable to operations analysis 
techniques. 

2. Definition of that problem in an appropriate forn, 
including definition of objectives, requirements, and 
constraints. 

3. Definition of the system itself, beginning with gross 
approximations and working toward minute preciseness; 
the result should be a conceptual model on which 
quantitative analysis may be performed. 

4. Definition of performance criteria for the system as 
a whole, for the various levels of organization, and 


for the combination of its constituents. 
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5. Definition of alternative configurations, and evalua- 











tion Of metradesorrs (using operations research 


technigues). 


6. Presentation of alternatives and trade-offs to the 
user. 
7. Performance of ongoing, Lterative engineering aaa 


human factors analyses during system development. 

8. Analysis of operational systems, to gather 
performance data. 

Although operations analysis may have a qualitative 
beginning, guantification is reguired as the system 
develops. The ensuing guantative analyses then include: 

1. Determination of the functional relationships of 
performance parameters, uSing mathematical models to 
describe subsystems and systems. 

2. OQptimization of the system, using predetermined 
Criteria. 

3. Determination of the variations in system performance 
associated with changeS in constraints, external 
requirements, etc. | 

Note that "quantitative" refers to the degree or level 
of measurement of some quality or attribute. Thus ae 
includes ordinal relationships such as "more versus less" 
and "better versus worse", in addition to interval and ratio 
measurements. It also includes probabilities, as well as 


discrete numbers. 


C. OPERATIONS RESEARCH 


According to DeGreene [Ref. 14], operations research is 
the application of quantitative, mostly probabilistic tech- 
higues (largely at the subsystem level) to the management 
and control of specific complex systems. He contrasts this 


with systems analysis or operations analysis, which applies 
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a similar body of technigues to systems to obtain general 
(as opposed to systemspecific) data--which then can be used 
for general predictions of system and human performance 
reliability. | 

As noted in the above section, the techniques developed 
under the umbrella of operations research are used during 
the process of operations analysis-- specifically, during 
definition of alternative configurations and evaluation of 
Peade-Ofrs. Thus, in this sense, operations research can be 
considered a subcategory of operations analysis. 

Operations research techniques usually are applied to 
problems of conducting or coordinating operations or activi- 
ties within an organization, according to Hillier and 
Lieberman [Ref. 15]. The nature of the organization is 
immaterial; breadth of applications is wide. The discipline 
is concerned with optimal decision making in, and modeling 
of, deterministic and probabilistic systems that originate 
from real life. 

Not all operations research problems involve systems 
engineering or human factors engineering. However, when 
predictions about the most efficient operation of a not-yet- 
constructed man-machine system are needed, .-the knowledge 
provided bv human factors engineering becomes vi tal 
[Ref. 16]. 

The approach of operations research basically involves 
use of the Scientific method. Daellenbach and others 
provide five major steps or phases for a successful 
Operations research project [Ref. 17]. These include: 

1. Defining and formulating the problen. 
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2. Constructing a mathematical model to represent the 
Operation studied. 

3. Deriving a solution to the model. 

4. Testing the model with empirical or other practical 


data, evaluating whether the solution yields 
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acceptable values for the measures of effectiveness, 
and, feds Noe, Making appropriate changes or 
refinements. | 


5.- Implementing, Maintaining, and using the solution for 


predictions 
The above steps assume _ that the problem is well- 
structured, a condition necessary if we are to approach it 
with the usual operations research procedures. Daellenbach 
and others [Ref. 18] list Six characteristics of a 
well-structured problen: 
1. Any knowledge relevant to the problen can be 


represented in an acceptable model. 


2. An acceptable model will encompass al 


feasible 
solutions. 


3. Definite criteria are available for judging the 
feasibility and optimality of any solution. 

G4. A programmable method (that is, one which can be laid 
out in logicai steps) exists for finding the optinal 
solution. 

5. The solution method does not reguire more computation 
than is economically practical. 

6. All information required by the acceptable model is 
available or can be obtained economically. 


Wagner [Ref. 19] notes that the distinguishing 


characteristics of operations research include the 
following: 
1. A primary focus on decision making: the analysis 


must have direct and unambiguous implications for 
action. 

2. An appraisal cesting Oh criteria of economic erie. 
tiveness: a recommended solution must take into 
account the cost and return tradeoffs, based on some 
measure of effectiveness, so that a balance has been 


struck. 
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3. Reliance on a formal mathematical model: data manip- 





ulation procedures should be so explicit that they 
can be described to another analyst, who could then 
derive the same results. 


4, Dependence on an electronic computer: this charac- 
teristic is not necessarily desirable, but 1S a 


reflection of the complexity and size of most prob- 
lems tackled under the banner of operations research. 

The concept of measure of effectiveness (MOE) deserves 
elaboration. Under the "systems point of view", fa hal 
criteria of overall system performance are used to evaluate 
individual design decisions [Ref. 20]. The measure of 
performance or effectiveness used most often in operations 
research is cost in dollars. 

Some operations research technigues are intended for 
problems where only a Single objective (e.g., cost) is to be 
met, and only one measure of effectiveness is used. Other 
techniques can handle several objectives at once. Sti: 
Others are used within a framework of continuous (rather 
than discrete) variables and objectives. 

A conflict between operations research and human factors 
engineering must be considered here. For the human factors 
engineer, measures of effectiveness usually are based on 
some human performance outcome, described by one or more 
observable attributes (such as speed or accuracy), that is 
associated with each of the operator's alternative courses 
Sieaction. These attributes are used to measure how effec- 
tively each outcome will meet the decision maker's objec- 
tives. Pre-set criteria or standards must be available in 
order to measure the "goodness" of each outcome (ior 
example, a criterion that data will be entered ona kevpad 
With an error rate of five or fewer incorrect entries fer 
100 keystrokes). 
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The problem, as Chapanis points out [Ref£. 21], is that 
most human factors research 1S carried out under carefully- 
controlled, generalizable conditions so that results will be 
widely applicable. This creates an extremely serious short- 
coming in most human factors data; Since they were not 
obtained under realistic conditions (which are not so gener- 
alizable), they cannot be entered directly into the opera- 
tions researcher's cost equations. It does little good to 
set a measure of effectiveness of error rate unless we know 
how much an error costS--in dollars, lives, time, etc. 

Chapanis recommends that, whenever human factors results 
are to be used in operations research nodels, these results 
be expressed in systems-relevant measures. These include 
measures such as a pilot's delay-time expressed in the 
amount of fuel consumed by the aircraft during the delay, 
and pilot error rates expressed as the probability of 


mid-air collision as a function of these errors. 


De. OPERATIONS RESEARCH TECHNIQUES 


An operations research technigue can be considered to be 
a:verbal, physical, Or mathematical procedure (usually 
mathematical), defining or performed on a model, that either 

1. elucidates a specific yuestion about a systen, 
condition, or event (using a descriptive model); or 

2. that gives a quantitative answer to such a guestion 
(uSing either a descriptive or prescriptive model). 

The basic categories of models (descriptive, prescrip- 
tive, etc.) and the relationships between models and 
techniques are discussed further in Chapter V. 

Table 2 lists a number of operations research models and 
techniques, applicable to human factors engineering prob- 
lems, which are discussed in this study. These have been 
categorized under three "purposes": 
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TABLE 2 


MODEL TECHNIQUE 


| 
OPERATIONS RESEARCH MODELS AND TECHNIQUES | 
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Deterministic models 





Regression analysis 
Factor analysis 
Discriminant analysis 


Canonical correlation. 

Multidimensional scaling 

Mangal control 

Optamal Gontrol 

Time series models 
Stochastic models 

Markov chains 

Poisson processes 

Queueing processes 

Reliability models 


Simulation models 
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Linear programming models 
Nonlinear programming models 
Network mnodels 


Distribution models 


Decision theory models, decision analysis 


Signal detection theory models 
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1. Describing systems, - and description- based 





tet LONS-: These techniques involve finding or 


; 
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or 


developing some mathematical formulation that repre- 
sents existing knowledge about the system well enough 
so it can be extrapolated to predict the performance 
which is expected under somewhat different condi- 
tions. These describing functions are divided here 
into deterministic, stochastic, and simulation 
models--to make it easier to see differences and 
relationships. Meanings of these terms are discussed 
in Chapter V or in the introduction to Chapter VI 
(and also in the Glossary). 

2. Maximizing, Minimizing, and meeting Constraints. 
These techniques find ways to satisfy a number of 
criteria simultaneously (or sometimes serially), 
within bounds set by nature or human organizations, 
to obtain the best possible solution to a problen. 
Linear and nonlinear programming, network, and 
distribution models are included in this category. 

3. Making choices and decisions. Given a list of alter- 
natives, these technicues are used to perform anal- 
yses and evaluations in order to determine which 
alternative will best meet some given criterion or 
aspiration level. This category includes techniques 
derived from decision theory and fron Signal 
detection theory. 

Any scheme for separating models into some set of 
categories is of course based on someone's judgement. Itis 
also pointless, unless there is some value to be gained by 
this categorization. The vaiue here lies in the fact that 
models and technigues must be used, must have a purpose. 
Otherwise, they are merely intellectual exercises. The 
purposes or categories used here suggest what the models 
included in this study are good for. They should aid the 
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human factors engineer as he screens the various techniques 
to see which (if any) are applicable to whatever questions 
he needs answered. 

Other scientific disciplines will be required for imple- 
menting such technigues--primarily those of mathematics. 
Therefore, we will define a mathematical tool as a procedure 
Which does not, in and of itself, answer a specific ques- 
tion, but which is necessary in order to use an operations 
research technique. That 1s, it can be considered an 
instrument, or a means to an end. 

Table 3 lists some of the most common nathematical tools 
used with operations research techniques. Several of these 
already are an integral part of the psychologist's or human 
factors engineer's bag of tools (probability, statistics, 
experimental design, etc.). These tools for measuring and 
estimating, for making decisions about hypotheses, and for 
planning are equally important for many operations research 
technigues. 

Others of these mathematical tools may not be _ so 
@amniliar. It is important to note that not all of these 
tools are necessary for any single operations research tech- 
hique. As each technique is discussed, we will note which 
specific tools are needed, so the user can determine whether 
he already has the requisite skills or whether he can obtain 
them easily enough to make the technigue practical for his 
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E. COMBINING HUMAH FACTORS AND OPERATIONS RESEARCH 


The basic procedure used in this study is to identify. 
and describe specific operations research models and their 
accompanying techniques, and to apply some of these models 
to given human factors-related problems. Table 4 ilius- 
trates the format which is used throughout the report. FOE 


each model or technique, the following are provided: 
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TABLE 3 
MATHEMATICAL TOOLS FOR OPERATIONS RESEARCH TECHNIQUES 


Arithmetic 

Algebra, simple 
Algebra, linear or matrix 
Algebra, Boolean 
Geometry, plane. 
Geometry, spherical 
Geometry, analytic 
Trigonometry 


Calculus, single variable 
Calculus, multiple variable 


Logic and set theory 
Fuzzy set theory 


Probability theory 


Statistics, descriptive 
Statistics, inferential 


Experimental design 
Graphs and plots 


Computer programming 
Computer packages 
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1. The kinds of guestions or problems for which itis 


especially useful--that is, what it is good for. 


2. The kinds of mathematical skills required for proper 


use. 


Sj. in general, the kinds of human factors engineering 


applications we see as particularly appropriate. 


4. Examples of the use of the model for human factors- 


related problems, as reported in the literature 


(where available). 
5. References and texts for more information, 


desired. 
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TABLE 4 


DESCRIPTION OF OPERATIONS RESEARCH MODEL/TECHNIQUE 


a) 
b) 
C) 
dq) 
€) 
f) 


a) 
b) 
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2e MATHEMATICAL TOOLS REQUIRED 


OPERATIONS RESEARCH MODEL/TECHNIQUE: 


1. PURPOSE OF MODEL/TECHNIQUE: 


S. HUMAN FACTORS APPLICATIONS: 


wen PeSCRIPTION: * 


Model : 
Assumptions: 
Strengths: 
Weaknesses: 
Procedures: 


Other calculations that may be 


3- ACM EXAMPLE: * 


Situation: 


Procedures: 


fee ooED IN LITERATURE: 


een orbRENCES AND TEXTS: 


*For selected models only 
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For several of these techniques (primarily those that are 
among the most important for the operations research field), 
additional elaboration on ‘the model or technigue is 
provided: 
6. The assumptions underlying the use of this model or 
technigue. 
7. What its strengths and weaknesses are. 
8. General procedures for using the technique. 
9. A worked-out example of application of this technigque 
to a human factors problen. 

Descriptions necessarily are brief; no attempt is nade 
to be mathematically rigorous or to cover all of the rich 
compiexity of many of these techniques. Such a compendium 
would require many volumes. It also would defeat the 
purpose of this study, which is to familarize human factors 
engineers with a set of practical tools, and help them 
decide which of these tools may be applicable to their 


special] problems. 
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IIT. NAVY MISSIONS: AIR COMBAT MANEUVERING 


The U.S. Navy is tasked with a number of critical 
missions, all related in some way to defense of our forces 


at sea. Table 5 lists these mission areas. 


TABLE 5 
NAVY MISSIONS 
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Sea control 
Power projection 


Fundamental missions 
Antiair warfare 
Antisubmarine warfare 
Antisurface ship warfare 
Mine warfare 
Air-to-ground warfare 


super iies missions 
obilit 
eomeaad. Control, Communicatons 
Intellegence 
Electronic warfare 


| Logistics 


For Simplicity and consistency, a Single mMisSion area, 
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that of antiair warfare, has been selected here for illus- 
tration of how operations research technigues may be applied 
to a variety of human factors engineering problems. Within 
that broad area fall both surface-to-air and air-to-air 
combat. The latter of these will be given primary emphasis 
in this study. 
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Air-to-air combat most often is referred to as "air 
combat maneuvering" or ACM. It involves in-air battles 
between two or more adversary aircraft. The three- 
dimensional nature of such battles in Space makes them espe- 
cially rich material for modeling. Navy fighter aircraft 
carry either a single pilot or a pilot and a weapons systen 
officer (often called a radar officer (RO) or a radar inter- 
cept officer (RIO)). Depending on the type of plane, 
on-board sensors include various radars, infrared systems, 
television systems, and laser detectors (plus occassionally 
rifle scopes purchased at a local sporting goods store). 
Electronic countermeasures also can add complexity to sample 
scenarios, aS can various rules of engagement (such asa 
requirement for visual identification of the adversary 
before missile engagement). 

The Navy's fighter aircraft include the F-4 Phanton, 
F-14 Tomcat, and F-18 Hornet. The first two are two-seat 
and the third a single-seat aircraft. U.S. Navy air-to-air 
weapons consist of: 

1. Aircraft guns, for close-in engagements (often called 
dogfights) 

2. Sidewinder (AIM-9) heat-seeking missiles, fou 
Short-range engagements 

3. Sparrow (AIM-7) radar-guided missiles, for short- and 
intermediate-range engagements 

4. Phoenix (AIM-54) radar-guided missiles, for long- 
range engagement of enemy aircraft (F-14 aircraft 
only) 

For this study, data, procedures, and tactics fron 
various ACM-related activities will be used in modeling, 
anaiysing, and making decisions about this type of mission, 


uSing a variety of operations research technigues. 
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A major attempt was made to review existing literature 
involving some aspect of the combination of human factors 
and operations research. Some 1500 citations were obtained, 
using keywords related to both of those two disciplines. 
Review of abstracts of these publications revealed a signif- 
icant point: authors and abstractors use extremely broad 
definitions of these two fields. Numerous citations 
involved neither of the two, as they are defined for this 
study. 

An early review, conducted by Raben in 1960 [Ref. 22], 
apparently yielded a Similar result. She reviewed 1000 
references, and included approximately 500 of these in her 
report. The definition of operations research she uses is 
very broad: 

1. Moving scientific research into the everyday world of 
business, government, and industry. 

2. Providing decision makers with an efficient basis for 
making decisicns regarding the operations under their 
control. 

3. Going after the immediate problems in complex 
organizations. 

Operations research was still a young field at that time 
(the original text on the subject, Morse and Kimball's 
Methods of Qperations Research, was only 10 years old). 
Basically, four operations research techniques are included 
in Raben's study: 

1. Communicaton and information theory 

2- Game or decisicn theory (Which includes a very brief 
reference to linear programming) 


“em Computers and simulations 
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G. Queueing theory (lncluding work measurement 
techniques) 

For choosing an operations research technique, Raben 
quotes Hoag [Ref. 23] as proposing that one examine the 
problem at hand and ask: 

1. What are the relevant alternatives? 

2. What test of preferences should be applied in 
choosing among alternatives? 

3. How do we go about the process of weighing objectives 
against costs? 

Of the 500 reports cited by Raben, less than 20 appear 
to meet our present criteria of human factors engineering 
and operations reSearch in combination. The rest are about 
evenly divided between relatively "pure" psychology or human 
factors books, reports, or studies (i.e., E.J. McCormick's 
Human Engineering), and relatively "pure" mathematics or 
operations research books, reports, or studies {i.e., R.L. 

For this present study, citations were obtained from the 
Defense Technical Information Center (DTIC), and the DIALOG 
Information Services PSYCINFO database, along with the Naval 
Postgraduate School thesis and reports database retrieval 
system. In addition, a collection of about 500 citations of 
operations research/human factors reports, compiled by 
students for human factors courses in the Operations 
Research Department, were reviewed for applicability to this 
project. 

Of these varied citations, 55 definitely pertain to both 
operations research and human factors, and are listed in 
this thesis either in the list of references or under the 
technigue or model to which they apply. An additional 234 
Citations have some applicability; the most pertinent of 
these are included here. Another 159 were noted and 


reviewed, to some extent, but were found of little interest 
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for this study. All-in-all, more than 450 reports were 
reviewed, either in the form of the original publications or 


from an abstract. 
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V- SODELS AND MODELING 
Before beginning discussion of some of the specific 
types of models used in operations research, it is useful to 
consider the topic of models in general. What is a model? 
How do we develop or select an appropriate nodel? And what 


do we do with a model, after we have one? 


A. THE NATURE OF MODELS 


Model building is considered by Wagner {and many others) 


to be the essence of operations research [ReE—. 24]. By 
formulating, manipulating, and analysing models, it is 
possitle 


1. to put the complexities and uncertainties attending a 
decision-making problem into a logical framework 
amenable to comprehensive analysis, 

2. to clarify decision alternatives and their 
anticipated effects, 

3. to indicate the data that are relevant for analysing 
the alternatives, and 

4. to lead to informative conclusions. 

Tk Shore, the model isa vehicle for arriving at a 
well-structured view of reality. 

Even more important, the model is what is used with 
operations research techniques. These procedures are not 
intended for operations on real-world objects, but rather on 
“some abstraction of reality--on some representation (shadowy 
or concrete) of such objects. 

But what is a model? According to Kantowitz and Sopa 
[Ref. 25], models are abstract representations of systems or 


subsystems. Models attempt to describe, explain, predict, 
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or control the behavior of whatever they represent. Models 
can be verbal, physical, mathematical, or a combination of 
these. Examples include: 

1. Verbal/symbolic: a description in words and geome- 
tric symbols, such as a sequential flow diagram (as 
in Figure 2.1) or an operational seguence diagran. 

2. Physical: a model airplane in a wind tunnel, ora 
set of electronic components wired together to 
represent a tornado--or even a military exercise. 

3. Mathematical: almost any function, equation, or 
inequality: e=mc® is a model of the energy-mass 
relationship; speed < 55 mph is a model representing 
a standard constraint placed on highway travel; 
computer Simulations usually are based on math 
nodels. 

Rouse likens a model to an analogy [Ref. 26}. One of 
the most powerful problem solving methods in science, this 
involves viewing a new problem as if it were an old problen 
for which one may know the answer, or at least possess 
considerable insight. The set of analysis tools already 
proven for the old problem then is available for attacking 
the new one. 

Continuing in this vein, Rouse suggests nine analogies 
of human behavior he considers useful in the modeling 
process [Ref. 27]. These are: 

1. Electrochemical network: treating the human as a 
Simple net of neurons which interact according to 
basic physical lavws. 


2. information processor: uSsiny models normally used 





for storage and retrieval of symbols, or during 
employnent of information theory (as 7136 a 
communications channel). 

3. Pattern recognizer: use of product inspection and 


process monitoring nodeling technigues. 
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4. Ideal observer: models used in estimation theory or 
in Signal detection theory. 

5. Servomechanisn: vehicle control, trachang, and 
process control analogies and models. 

6. Time-shared computer: resource allocation models. 

7. Logical problem solver: use of set theory opera- 
tions, including logical implications and procedures. 

8. Planner: rule-based (or production) systems and 


models, or time/frequency domain series models. 


9. Reflector-daydreamer;: the upper limit on modeling 
the human, requiring techniques that are not fuily 
established. 


These individual analogies or Simple models may be 
combined into what Rouse calls composite analogies: struc- 
tures or frameworks integrating two or more of the basic 
analogies into a cohesive, purposeful entity. Such a 
structure then may be used to describe behavior. 

When an analogy within a particular area of research 
gathers a sufficient number of adherents, it is often termed 
a paradigm. Rouse awards paradigm status. to the analogy of 
the human as a servomechanism--an error-nulling Or 


self-correcting device. 


What characterizes a good model? According to 
Daellenbach and others [Ref. 28], there are five impcrtant 
qualities: 


Wee a AS 1 eaves Only those aspects of the system that 
have significant effects on performance should be 
included. 

2. Robustness. It should be difficult to cause the 
model to give bad answers, particularly answers that 
are outside the previous range of experience. 

3. Ease of manipulation and use. Extensive training or 


experience should not be required. 
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4. Adaptability. It should be easy to change input 
parameters and obtain updated solutions. ; 

5. Completeness. All important aspects of the systen 
should be included in the model. 

6. Ease of communication. The user Should be able to 
change inputs eaSily and obtain answers quickly. 

There are a number of ways models can be classified into 
categories. Two of the most useful divide them into either 
deterministic or probabilistic classes, and into either 
descriptive or prescriptive classes. 

In brief, a deterministic or mechanistic moiel considers 
RhRature to be a fully predictable machine, and implies that 
one will use it "to find out exactly". This is known as 
decision making under certainty. Such a model yields a 
humber (or a seyuence of numbers) as its end product--with 
certainty. For example, given a specific input, the output 
will be a number or range of values (dollars, kilograms, 
etc.) which will result from a given manufacturing process, 
under controlled conditions. 

A probabilistic model deals with problems of decision 
Making under uncertainty or risk, typically assuming that 
the probabilities of the alternative states of nature are 
known. A stochastic model is a probabilistic model which 
has time as one of its factors. These types of models work 
with a collection of assumed possible outcomes, and usually 
yield a probability or set of probabilities for these 
outcomes as its end product, according to Larson [Ref. 29}. 
Weather forecasting models are probabilistic. So are many 
other forcasting models, which provide the likehood of some 
occurrence, based on a given set of conditions. 

A descriptive model is just what it sounis like: it 
attempts to describe the system being modeled. This 
description then can be used for prediction or decision 
Making, if desired. Most stochastic models are descriptive 


me nature. 
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A prescriptive model prescribes what action should be 
taken with a system to obtain a desired outcome. -Linear and 
nonlinear programming models are examples of prescriptive 
Models. Given a set of variables, X, under our control, and 
a set of variabie outcomes, Y, not under our control except 
that they depend on X, then our criterion function or objec- 
tive function is £(x,y), a function of both of these vari- 
ables. This criterion function often is used used in 
setting up a measure of effectiveness (MOE). The possible 
values of X result in various values for Y and for the func- 
tion f--some "better" or more effective than others, for the 
system of interest. The goal is to select a value of X 
which will yield a solution that is "good enough" (or, to 
use the decision theory term, is “satisficing"). 

Rouse suggests that models can serve four purposes 
[Ref. 30]. These include: 

1. Providing insight into the system and its interrela- 
tionships, for which the modeling process in and of 
itself is beneficial (regardless of the ability to 
make further use of the model). 

2. Giving succinct representations and explanations of 
data, aliowing clearer comparisons among tasks and 
experiments. 

3. Assisting in design of experiments, after an approxi- 
mate model suggests what parameters may affect 
performance most strongly. 

4. Yielding quantitative predictions about the systen 
that was modeled. 

Rouse also makes a distinction between human-systen 
behavior models and performance models [{Ref. 31]. The 
former are more general and more difficult to develop, since 
a variety of patterns of behavior might result in the same 
performance. For many engineering applications, performance 


predictions are all that abe neéeessary- While the 
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"stronger" behavioral models more completely describe the 
human as the task of interest is performed, they also may 
result in such generality that the engineer cannot use their 
answers. 

Models may be special purpose (peculiar to a specific 
problem) or general purpose (adaptable to any system which 
satisfies the underlying assumptions). Although general 
purpose models are sometimes simply referred to as tech- 
higues [Ref. 32], for purposes of this study, the two terms 
will be kept separate. Here, the model will be used to 
represent the systen, while the technique will be used to 
shed light on the system or to answer questions about the 
system, via operations performed on the model. 

Many problems may be solved through the use of several 
technigues (perhaps using several different models), each 
offering certain advantages. in order to choose the tech- 
higue that best fits the problem at hand, it is necessary to 
be familiar: with the features of each which make it espe- 
cially useful under various conditions. We will attempt, in 
this’ study, to point out these features. 

As a fanal point here, the limitations of models and of 
their corresponding technigues must be considered {Ref.j 33]. 
The ability to develop practical, useful models of 
human-machine interaction is limited by: 

1. Measurement and computational difficulties, since 
many human processes cannot be directly observed, and 
no two individuals may perform alike. 

2. The fact that the human often behaves in a hon- 
optimal manner, settling for "good enough"=--a very 
difficult situation to model. This may be a function 
of the artificiality of the laboratory environment. 
It also may be due to the limitations of working 
(short term) memory and the division of attention-- 


for example, conservatism in decision making is 
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nonoptinal, yet is consistent with known human 
limitations. 

Criticality of the environment in which a task is to 
be performed, making it difficult to generalize from 
one set of data to another. 

The virtual impossibility of modeling the totality of 
human behavior, including the above-mentioned 
reflecting and daydreaming activities. 

The difficulty of truly understanding most models by 


anyone other than the model's developer. 


B. THE PROCESS OF MODELING 


Sinciair and Drury suggest four yuestions to ask before 


beginning any modeling process [Ref. 34}. 
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Is mathematical modeling likely to be applicable and 
useful? Two areas representing safe ground for 
modeling are: 

a) Where it is reasonable to assume the man in the 
system is acting as a "logical machine". 

b) Where physiological or biodynamic processes of the 
human body are being modeled, with no "willful" 
control by the operator. 

At what level are you working? The man-machine systen 

as a whole can be modeled, or only individual compo- 

nents within a single man-machine system can be 
considered. 

Which is the JlJimiting subsystem? Is it the man's 

anatomy and physiology, his perceptual capability, or 

his decision making ability? Choosing the limiting 
subsystem will to a large extent force the selection 
of the type of model needed. 

Does an appropriate model already exist? The authors 

include a fairly comprehensive list of models (14 in 
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all) which have been successfully used in human 
factors work. These are categorized as biomechanics, 
man-in-loop, decision theory, visual search, and 
metabolic. Only if there is no satisfactory existing 
model should one consider building anew one "from 
scratch". 

Olkin [Ref. 35] considers models to be abstract and 
Simplified descriptions of given phenomena. Tempulid, a 
model, certain baSic aspects of the phenomenon are isolated 
as being of primary interest. An analogy is drawn between 
these aspects and some logical structure--concerning which 
we already have detailed information (see Figure 5.1). 
Models most often are based on mathematical structures of 


various kinds. 
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Figure 5.1 Modeling Process, as Described by Olkin 
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A model need not be complex or completely precise to be 
userul. Criteria for choosing a model are practical, not 
metaphysical, Olkin emphasizes. Does the model provide a 
Simple, yet comprehensive explanation of the known phenon- 
Emon? At the same tine, does it have strong potentiality 
for providing insight into the natural world? Taaiso, it 


warrants consideration. 
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To be of use, a model must be elaborate enough to repre- 
sent reality, but also sufficiently simple to remain trac- 
table, ~Daellenbach and others emphasize [Ref. 36]. 
Simplicity in a model can be achieved only by making suit- 
able approximations. These authors list six useful ways to 
do so: 

1. Omitting variables. To determine whether a variable 
has a significant effect on the measure of effective- 
ness, statistical tests and techniques such as corre- 
lation, regression analysis, and analysis of variance 
and covariance are used. Variables which contribute 
only insignificantly to description of the systen 
Should be removed. 

2. Aggregating variables. Activities and items which 
are Similar can be lumped into a single variable, as 
can those which individually have low values. 

3. Changing the nature of variables. Sometimes vari- 
ables may be treated as constants, for simplicity's 
sake--such as when an average value is substituted 
for a random variable, or when conducting a para- 
metric analysis. Discrete variables may be treated 
as continuous, and vice versa, when it is useful. 

4. Approximating the frelationship between variables. 
Linear and quadratic functional relationships are 
easier to deal with than are cubic or other nonlinear 
functions, and the simpler relationship may be 
entirely adequate for modeling purposes. 

5. Ort ewng constraints. Limitations which make 
modeling difficult may be ignored, initially. If the 
solution is found to violate one or more of these 
constraints, they subseguently may be introduced. 

6. Disaggregating the entity modeled. One single model 
that covers the entire system may be highly complex 
and difficult to find a solution for; such a preblen 
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nay be broken into snaller and Bae tei Y 
self-contained submodels, as an approximation. 

There is no "recipe" for making models, notes Morris 
[Ref. 37]. The teaching of modeling is rot the same as the 
teaching of models, he states. Modeling tends to be an 
intuitive or artistic skill, largely the result of imitation 
and practice. Facility in modeling appears to be associated 
with a feeling of being at ease with mathematics, an appre- 
Ciation of the various purposes models may serve, and 
familiarity with the characteristics of models. 

Morris provides seven suggestions for the novice 
model—-builder: 

1. Factor the system problem into simpler problems, 
which can be modeled individually, then recombined 
into a system model. 

2. Establish a clear statement of the deductive objec- 
tives: the purpose of the model and what the results 
are to be used for. 

3. Seek analogies between the problem at hand and some 
previously well-developed logical structure; is the 
problem one in linear programming, in gueueing, or in 
lnoventory? 

4. Consider a specific numerical instance of the 
problem; retreating from generality and complexitv 
helps to make clear the assumptions which charac- 
terize the example, and frequently allows "solution" 
by inspection. 

5. Establish some symbols: write down in symbolic terms 
(letters and numbers and arithmetic operator charac- 
ters) some of the obvious things which can be seen in 
the numerical example. 

6. Write down the obvious: conservation laws, input- 
Output relations, ideas expressed in the assumptions, 


or the consequences of trivally simple policies. 
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7. j%&«If a tractable nodel is obtained, enrich Ge 
Otherwise, simplify. 

Given the model, regardless of its type or degree of 
complexity, it now should be possible to apply various oper- 
ations research techniques in order to answer some of the 
questions of interest (or at least to understand the 
problems better). 


C. FINDING AND EVALUATING SOLUTIONS 


Having settled upon an appropriate model for a given 
human factors engineering problem, the next step is to find 
a solution. Operations researchers speak of solving the 
model or of finding its solution. Specific ways of finding 
solutions using the operations research techniques covered 
in this study are included in each technigue's section. 
However, the more generalized concept of finding optimal or 
acceptable solutions should be discussed first. 

The desired solution sometimes may be discovered simply 
by breaking a problem down into its component parts, tJlaying 
these out in some logical pattern, and inspecting then 
closely. This is solution by analysis. 

More often, humeric methods are required. The nost 
powerful numeric methods are based on an algorithm 


[Ref. 38]. An algorithm may be defined as a set of logical 


and mathematical operations performed in a speci fic 
sequence. Sometimes this is done by hand--pap2r and pencil 
and a hand calculator. More often (in operations research, 


at least) a computer is used. 

To use an algorithm, usually an “initial solution" is 
needed. This may be obtained by some arithmetic or logical 
technique, or simply by guessing, based on whatever data are 
available about the system of interest. The algorithm is 


applied to the initial solution, in order to derive a new 
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(and, ideally, better) solution. The sequence of operations 
leading to the new Solution is called an iteration. The new 
solution is substituted as the starting point, and _ the 
process repeated. This continues until certain conditions 
{called stopping rules) are satisfied. At this point, the 
optimal solution has been reached with the desired degree of 
accuracy--or else no feasible and bounded solution exists, 
aS the problem is presently set up. 

Daellenbach and others list the properties of a 
practical, useable algoritha: 

1. Each successive solution must be an improvement over 
the preceding cne. 

2. Successive solutions must converge to the optimun 
solution. 

3. Convergence must OCCU cote fi nade number of 
iterations. 

4. The computational requirements of each iteration must 
be sufficiently Smali to remain economically 
feasible. 

Given a possible solution, sensitivity analysis usually 
is performed on it. How the optimal solution would change 
if input data are changed {as they might change in the real 
world) is systematically evaluated. This 1S especially 
useful in determining just how accurate the input data for 
the model must be. It also establishes the range within 
which input values may vary, given this model, and still 
result in a near-optimum Solution. And if: some of the vari- 
ables represent resources which are scarce, sensitivity 
analysis enables one to place a value on. these resources 
[Ref. 39}. 

Before any solution 1S implemented into a freal-world 


Systen, it must be validated or tested. This 1S necessary 





to determine that the solution will remain feasible when 


introduced into the actual (versus the model) situation, and 
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that the benefits will be sufficient to warrant the required 
changes. 

Cross validation usually is done by checking the 
proposed solution with new data (not that used to derive the 
model and optimal sclution). These data values must be 
representative of future behavior of the system, and the 
testing should be extensive enough to allow for evaluation 
of the variability of the outcomes with time. 
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Vi. MODELS FOR DESCRIBIN 


AND PREDICTING 


A vastly heterogeneous set of mathematical procedures is 
included in this chapter. They are linked together by their 
common purpose: describing some system in mathematical 
terms, so that predictions may be made about the systen. 
Under some conditions, each technique provides more 
predictive ability than could be obtained simply by using 
the average value of past performance as a predictor of 
future perfromance. This is a good criterion for a useful 
model [ Ref. 40}. 

Researchers collect varying kinds of data, in a variety 
of ways, depending on the situation of interest. ACGOEGING 
to Nie and others [Ref. 41], the most common situation is 
one in which only a relatively small number of variables are 
to be analysed. For any one piece of analysis, it usually 
is possible to arrive at one dependent variable that is to 
be explained and at a limited number of other variables with 
which to explain it. Multiple regression is the procedure 
of choice in such an instance. 

As the number of variables in the data set becomes 
larger, multiple regression becomes an unwieldy technigue. 
Some form of data reduction is needed in order to make sense 
Seeit ail. Factor analysis is the most common technique 
used for this purpose, combining several variables together 
to yield a single new variable (representing some larger 
Soncept). 

Closely related to the above two techniques is that of 
discriminant analysis. This 1s the technique of preference 
if we desire to separate two or more groups of individuals 
on the basis of some discriminating factor. As with the 


above two (and also the following two), this technique 
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relies on a deterministic model, and requires that the meas- 





urement level of the variables be at least interval ‘in 
nature, that relationships be linear, and that data values 
be known constants. 

A fourth related technique is canonical correlation. To 
use this procedure, the experimenter divides his variables 
into two sets, each of which can be given theoretical 
meaning aS a set (such as a behavioral set and an attitu- 
dinal set). Then a linear combination is derived from each 
set in such a way that the correlatiuon between the two 
linear combinations is maximized. The goal is to account 
for a maximum amount of relationship between two sets of 
variables (rather than accounting for the maximum total 
variance). A redundancy index is used for this purpose. 

Multidimensional scaling is the fifth technique covered 
here. This procedure is intended for analysis of opinions 


about proximity from populations of interest, rather than 





for analysing and modeling experimental data. The end 

result 1s a graphical representation which describes a 

system and perhaps may be used in making predictions. 
Control models are already in wide use in human factors 


analysis, at least in theoretical descriptions of the human 


aS a controller. Thus these are touched on only briefly 
here. Time series models also are described only briefly 
here. They reguire computer packages to be of use 


(Box-Jenkins in SPSS, for example), and are best understood 
in the context of the particular computer and software that 
are available. 

The next three techniques fall in the category of 
stochastic models. Markov chains, Poisson processes, and 
queueing processes are important general operations research 
nodels. Iwo of the three are discussed in depth, so that 
human factors engineers may observe the usefulness of such 


procedures for their own modeling problems. 
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Reliability models also usually are stochastic in 
nature, Since they rely heavily on various probability 
distributions to predict failure rates. Little used by 
human factors engineers, they deserve consideration where 
human errors are an important consideration (and the avail- 
able data suggests that a known distribution is an adequate 
approximation for error rate). | 

The final modeling technigue covered in this chapter 
falis inthe broad category known as Simulation models. 
These versatile models can be either deterministic or 
stochastic. They are growing in popularity with human 
factors personnel, and are discussed here in depth. 


A. REGRESSION ANALYSIS 


i.  PURRGSE OF MODEL/TECHNIOUE: Determining the mathe- 
matical relationship between a dependent or criterion 
variable and one or more independent or predictor 
variables, in order to describe that relationshifp and 
to make predictions based on whatever data values are 


available. 


For example, the researcher may wish to predict the 
effect of age and of IQ (independent variables) on 
ability to operate a new tactical computer systen. 
The criterion is the time reguired to solve a stan- 
dard problem using that computer. One hundred 
Subjects of known ages and IQS are tested on that 
problen, and their times for solution recorded. 
Multiple regression techniques then are used to 


develop an equation of the forn: 
Y= A+ BX(1) + CX(2), 


where Y represents the estimated or predicted time 


value that will result from this equation. A is the 
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Y-axis intercept, Bis the regression coefficient 
related to age, X(1), and C is the regression coeffi- 
cient related to IQ, X(2). Once A, B, andcC have 
been determined from the collected data through 
multiple regression techniques, various values of age 
and IQ may be substituted for X(1) and X(2) =in the 


equation, to come up with predicted time values, Y. 


MATHEMATICAL TOOLS REQUIRED OR USEFUL: 
a) Algebra 

b) Descriptive statistics 

c) Inferential statistics 

d) Graphs and flots 


e) Computer packages 


HUNAN PACTORS APPLICATIONS: 

a) Describing individual differences, in terms of 
expected responses or characteristics resulting 
from given inputs or from other personal 


Characteristics. 


b) Describing systems, when a functional relationship 
is desired between one or more independent vari- 
ables and some other variable which presumably is 


dependent on these. 


Cc) DeSigning systems, when predictions or inferences 
are needed in order to determine whether a system 
with certain given characteristics will result in 


desired (or necessary) human performance. 


d) Evaluating human performance, where performance 
can be measured in numerical terms and seems to be 
a direct result of certain conditions (which also 
can be measured numerically) imposed on or 


inherent in the human population of interest. 
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USED IN LITERATURE: It should be noted that’ the 
following list contains only a very small sample of 
the use of regression analysis for human factors 
research. This technigue, which is an 1lmportant one 
in operations research, has long been a mainstay of 


psychology, also. 


a) Bateman, R.P. "An Heuristic ap pees) to Work 
aes om RC Proceedings of the 23rd Annual Meeting 
of the Human Factors Society, Boston, HA, T9795, 

Bp.  to4—-55 75. a. 

- Regression analysis,is used to develop an equa- 
tion Showing the relationship of trackin erforn- 
ance to certain variables associate with | 
multifunction keyboards. 


b) Chawla, Sey and others. "Human Factors 
Considerations for a Combined Brake-Accelerator 
Eaaeo gs Pee@enonmics, Vol. 14, No. 2, 1971, ~= pp. 


Linear regression is used to relate accelerator 
and. brake reaction time with various pedal 
designs. 


eyevarseth, 1.0. "A Generalized Model of Temporal 
Motor Control Subject to Movement Constraints", 
Ergonomics, Vol 20, No. 1,_1977, pp. 41-50. 
Brot and second order linear regression models 
are formulated which relate mean arm movement time 
LO pacts  ouimdemeorwditficulty variable and toa 
lateral movement constraint variable, for a number 
of kinds of constraints. 


d) Wardle, M.G. "A Psychophysical penneach to 
EStimMating Endugpance i121 Performing hysicail} 
Demanding Work", Human Factors, Vol. 20, No. 6, 


729, Pps fto-747, 

Regression equations are developed which 
ear e poant estimates of the Maximum werking 
ime to be expected at various levels of strenuous 
workloads. 


Syebeeliages, K.G., and Williges, 8.4. "Modeling the 
Humah Operator 1n Computer-Based Data Entry," 
ot Miers, Ol. 24, NO. 3, 19382, pp. 285-299. 

Human-computer interfaces were evaluated via 
Operator satisfaction ratings, work-sampling tech- 
et and imbedded performance measurement. 
Polynomial Begeession pea le was used EO 
generate functional relationships among these four 
metrics and four independent variables trepre- 
senting system cee Oe oer rate, keyboard echo 
rate, and keyboard buffer rate. 
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REFERENCES AND TEXTS: 
ay Larson) § fH... introduction» to Probaba li ty Theory 
and Statistical “Inference, Third Edition. New 
York: John Wiléy and Sons, 1982. 
Provides theoretical and mathematical founda- 
paanS LOE regression, for the mathematically 
Inelin eds 


b) Mendenhall, Willian, Scheaffer, er re, and 
Rhee De Mathematical statistics With © 
Llications, Second Edmexonne Bosto ~Duxbur y 
ress, 
Clearly written, and nicely laid out for refer- 
ence. Heavy reliance on matrix eo ERLE Again, 
for the mathematically sophisticate 


c) Nie, N.H., and others. SPSS: Statastical Page age 
for the Social Sciences, Second Edition. New 
York: HcGraw Hill Book re alae Ue ify 

An excellent introduction to the technigue, as 
well as to the SPSS software progra ams to perform 
posse Note that tne later SPS Manual does not 
have the useful introductory information. 


tandin Sree St1ese An 
the Behavioral Sciences. 
Jovanovich, Incec., (970mm 


d) gig ight, MR 10) Underst 
TInformal introduction for 
New ore ~ Harcourt Brace > 


Eas non-threatening introduction to the 
subjec Oe regression and to statistics aa 
athe a Only Simple linear regression 1s 
included. 


e) Wonnacott, T.H., and Wonnacott, R.J. introductory 
oe ThliEd wate one New York:  Jdohn Wiley 
ons, 

An excellent introduction to, statistics in 
eneral, and to regression in particular, for 
hose with limite mathematical experience. 
Simple and multiple linear regression and nonli- 

near regression are discussed. 


f) Younger, M.S. fa ndbeok for Linear Regression. 
North Scituate, Mas Duxbury Press, 19 

Clear, com Tecor and eas to read text and 

reference boo tics the use of computer 


pcg tons for regression, such as BMD, SPSS, “ama 


Be. FACTOR ANALYSIS 


1% 


PURPOSE OF MODEL/TECHNIQUE: Obtaining a parsimonious 
description of observed data. This is done by 
reducing an apparently large number of variables 


(many of which are correlated with others) to a 
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Smaller number of source variables representing the 


same concepts, but under broader categories. 


For example, perhaps empirical data values have been 
obtained for a number of children on their age, 
height, weight, reading ability, and grade in school. 
Age, height, and weight are correlated, as are age, 
reading ability, and grade in school. Baetor anal- 
ysis may be used to reduce the five data values for 
each child to two--probably representing a physical 
maturity variable and an intellectual maturity 
variable. 


a) Algebra, simple, linear 

b) Calculus, single variable, multiple variable 
c) Logic and set theory 

d) Descriptive statistics 

e) Inferential statistics 

£) Graphs and plots 

g) Computer packages 


HUMAN FACTORS APPLICATIONS: 

a) Describing individual differences, where data 
values have been obtained for several human vari- 
ables, andit 1s desired to reduce these dimen- 


sions to a smaller, more meaningful set (factors). 


b) Describing systems, when numerous kinds of vari- 
able values are available for a system, and there 


is a need for reduced dimensionality. 


c) Designing systems, when the variabies for the 
proposed system are needed in a succinct and 


orthogonal form. 


aD 


d) Evaluating human performance, if a few, relatively 
uncorrelated descriptive variables are desired for 


use in the measurements. 


USED IN LITERATURE: 


a) Burke, _E.J. . "A Factor Analytic Investigationsoe 
Tests of Physical Working SS cae a Ergonomics, 
VOL. 3272, No. es 9 Pre l= ae s bs 

Sixteen tests of physical working _capacity, 
submitted to factor analysis, are reduced to three 
factors which account for 71 percent of the total 
variance. 


b) Haslegrave, C .i8e "Anthropometric Profile of 
British Car Drivers", Ergonomics, Vol. 23, No see 
1980, Jee 437-467. 

_. Factor analysis. is used to explore the. rela- 
tionships anend 17 dimensions used in design of 
GakES-. Three Lactors are extracted, then used in 
construction of a set of body indices for use in 
designing of anthropometric dummies. 


REFERENCES AND TEXTS: 
a) Harmon, 4.4. Modern Factor Re NE Chicager 
The University of Ch Gece Press, T 5 
A comprehensive and detailed text for those who 
want to know the theoretical and mathematical 
formulations for this procedure. 


b) Sioretson, Des. Multivariate Statistical Methods. 
New York: ee T3967. ; 
A mathematical explanation, wi fi heavy reliance 
On matrix algebra. 


c) Nie, N.H., and others. SPS 


S: Statistical Package 
for the Social Sciences, Beqoend | 5d 1 tason . ew 
York: McGraw HiliI Book Company, 1975. 

An excellent introduction to the technigue, as 
well as to the SPSS software pEcsrars to perforn 
altars Note that the later SPSS-X Manual does not 
have the useful introductory information. 


d) Rulon, P.J., and others. Multivariate Statistides 
for Personnel Classification. “New York: John 
Wiley and Sons, T9367. , 

A fairly complete explanation, including mathe- 
matical derivations, relying on graphical and 
matrix techniques. 
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C. 


DISCRIMINANT AWALYSIS 


1. 


PURPOSE OF MODEL/TECHNIQUE: To find and make use of 
characteristic variables which can distinguish 
between two or more groups. This 1s done via a 
collection of discriminating variables that measure 
levels of the characteristics on which the groups are 
expected to differ. These discriminating variables 
are weighted and combined so as to force the groups 
(and individuals in them) to be as_ statistically 
distinct as possible. Both linear and nonlinear 


combinations are possible. 


For example, it may be desired to discriminate 
between persons who will work effectively with 
computer systems and those who will not. A set of 


discriminating questions could be devised and tested, 
for this purpose. These might query the individuals’ 
attitudes towards working alone, self-correction of 


errors, sedentary occupations, etc. 


MATHEMATICAL TOOLS REQUIRED OR USEFUL: 
a) Algebra, Simple, linear 

b) Logic and set theory 

c) Descriptive statistics 

gd) Inferential statistics 

e) Graphs and flots 

I) Computer packages 


a) Describing individual differences, by selecting 
group characteristics which can be used to define 
those differences. 


b) Describing systems, making use of the known char- 
acteristics of groups into which they might fail, 


and with which analogies might be useful. 


ow 


c) Designing systems, ‘taking advantage of knowledge 


of those characteristics that user groups prefer. 


d) Evaluating human performance, by determining 
whether various individuals fall into various 
performance categories (inexperienced, average, 


superior, etc.). 


USED IN LITERATURE: 


2) aie c meee Ee Optimal Assignment of Air Force 
Pilots, Final ~Keport. Government Bae = 
Announcements, _ February 1974. AD-781 035/1GA) 


wa multiple discriminant ana ysis 1s performed, 
using ten test scores and training grades to clas- 
sify anew pilot as optimally “aSsignable to a 
transport, fighter, or reconnaissance aircraft or 


mission. 
a apens 
a) Nie, “gi and others. SP Sse s aitis tical: rae 
for Pe cavern Sciences, Second mal tion. New 
YoEke Dt ooE Se HilI Book Comp ie to75 
An exceilent introduction to the igque, as 
a 


well as to the SPSS software Cogr 
BNC’. Note that the later SPS5-X Ma 
have the useful introductory informa 


Oo perforn 
1 does not 
jars 


b) Rulon, P.J., and others. Multivariate Statistics 
for Personnel Classification. New York: ~~ Jchn 
Wiley and Sons, 
A good, clear explanation, including mathemat- 
ical erivations, relying on graphical, caiculus, 
and matrix techniques. 


De. CANONICAL CORRELATION 


Ve 


PURPOSE OF MODEL/TECHNMeum: Given two sets of vari- 
ables, each of which has a theoretical meaning, a 
linear combination is derived from each set so that 
correlation between the two linear combinations is 
maximized. Several such pairs (canonizsal variates) 
of linear combinations may be derived from one data 
set. A redundancy index is used to account fora 


maximum amount of relationship between the two sets 
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of variables. This technhigue can be considered an 
extension of multiple regression analysis to the case 


of multiple criteria, 


For example, individual attitudes toward reading and 
toward arithmetic may be scaled by a group of indi- 
viduals (from zero for dislike to 10 for extreme 
enjoyment). The same individuals may be tested on 
reading speed andon computational speed. Data 
values for these two sets of variables (two variables 
per set, one set representing attitude and the other 
behavior) then can be compared, using canonical 
correlation. The resulting correlation coefficients 
are used in a mathematical function to describe the 
relationships between the two attituies and two 


behaviors. 





a) Algebra 

b) Descriptive statistics 
c) Inferential statistics 
d) Graphs and flots 

e) Computer packages 


HUMAN FACTORS APPLICATIONS: 





a) Describing individual differences, where differ- 
ences can be measured and grouped into two sets of 


variables whose correlations are useful. 


b) Describing systems, when system parameters can be 
treated as described above for individual 


differences. 


c) DeSigning systems, when it is important to relate 
one set of parameters with another in order to 


maximize the system's usefulness. 


SD 


d) Evaluating human performance, when performance 
variables can be measured and correlated with 
other variables in order to determine that 
performance will be good enough for the job to be 


done. 


USED IN LITERATURE: No examples of the use of canon- 


ical correlation were found, relating both to human 
factors and to operations research. 


REFERENCES AN 


AND 
a) Morrison, p 


=i Multivariate Statistical Methods. 
New York cGraw-Hilt Book SO EN, US SUE 
A brief explanation in mathematical terms, with 
heavy reliance on matrix algebra. 


b) Nie, N.H., and others. SESS: Statistaeal Package 
for the Social Sciences, Second Edition. New 
York: McGraw HilI Book SOP 19775. ; 

An excellent introduction to the technique, as 
well as to the SPSS software peggrans to perform 
DRC Note that the later SPSS-X Manual does not 
have the useful introductory information. 


c) Stewart, Deng ase and Love, Willian. "A General 
Canonical orrelation Index", Psychological 


Bulletin, Vol. 70, Noo) 3-7 coc er T 4 

A redundancy index is describe , to handle the 
previous canohical correlation problem of not 
providing a measure of redundancy in one set of 
variables, with respect to a second set. . The 
index represents the amount of predicted variance 
in a set of variables. 


E. HWULTIDIMNESSIONAL SCALING 


UA 


PURPOSE OF MODEL/TEGCHNGOUE: Determining the under- 
lying structure of a set of points in n-dimensional 
Space (for n-dimensional scaling), after individuals 
have assigned a set of proximities to the points 
describing how close (in distance or similarity) they 
believe each point is to every other point. The 
resulting multidimensional scaling solution provides 


the minimum number of dimensions underlying the 
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structure, and gives the order of the instances along 


each dimension. 


This technigue may be used in determining the dinen- 
sions of a given task, thus leading to development of 


aS Many unidimensional scales as the task has dimen- 


Sions. If each task component is rated in criti- 
cality, then weights can be assigned to each 
dimension. 


For example, 100 aviators may be tested with a symbol 
set proposed for use on a cockpit map display, to 
determine whether they feel they can discriminate 
rapidly between each pair. The result is a "confu- 
sion matrix", showing the percent of time each symbol 
will be confused with another. This matrix of values 
is entered into a multidimensional scaling computer 
program for analysis. The result is a two- 
dimensional plot which places easily confused symbols 
next to one another, and those seldom or never 
confused at greater distances from one another. The 
researcher then provides an interpretation to the 
results, ba sed on his expertise and on this 


configuration of points. 


MATHEMATICAL TOOLS REQUIRED OR USEFUL: 
a) Algebra, simple, linear 

b) Logic and set theory 

c) Descriptive statistics 

d) Inferential statistics 

e) Graphs and plots 

£) Computer packages 


HUMAN FACTORS APPLICATIONS: 
a) Describing individual differences, where opinions 


about similarities and disimilarities between 


individuals are desired. 


6 1 


b) Describing systems, where Similarities or proxini- 
ties between various components can be judged by 
individuals and then subjected to analysis for use 


in predictions. 


c) Designing systems, where it is necessary to deter- 
Mine that two or more components are or are not 
Similar or close, in order to make choices and 
decisions. 


d) Evaluating human performance, when performance can 
be judged in terms of proximities or similarities 


to various criteria. 


4. USED IN LIT 


a) Harris, D.H. "Human Dimensions of Water Resources 
Prange ng 3g uanae Factors, Vol. 19, No. 3, “T30ae 
PP computer-based multidimensional scaling _tech- 
Niques are used to determine the wo dimen- 

O 

A 


ERATUR 
D 


(ed 


Sional structure. of 42 factors relate water 
resources planning and decisions. value 
reflecting social importance is developed for each 
of these and for the five basic. dimensions 
emerging from the multidimensional analysis. 


5. REFERENCES AND TEXTS: 


a) Kruskal, J.B., and Wish, Myron. Multidimensional 

Scaling. Beverly Hills: Sage Publications, T9/3. 

Complete and readable explanation of the theory 

and procedures. . Computer programs for the tech- 
nique also are discussed. 

b) SAS Institute, SAS User's Guide. SAS 


ine 
Institute, Inc., 1979. i es, se 
Instructions for the a+ Her Rata Least Squares 
co eee (ALSCAL) program, using the SAS computer 
package. 


chose 


F. MANUAL CONTROL HODELS 


1. PURPOSE OF MODEL/TECHNIQUE: Describing human 


behavior in terms of a 


lo | 
Ih 
I< 
|O 


echanism (error-nulling 
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weve qeetn Orde “Lo predict the effect “of varying 


conditions on the operator's performance while 
controlling a system. The most important performance 
criterion iS minimization of deviation of the state 
of the controlled process from a desired state. A 
Simple tracking task, where an observer must keep a 
pipper on a target, 1s a good example of a use of 
this model. 


MATHEMATICAL TOOLS REQUIRED OR USEFUL: 
a) Algebra 
b) Single variable calculus 


c) Descriptive statistics 


HUMAN FACTORS APPLICATIONS: 





a) Describing individual differences, when an indi- 
vidual receives information through his’ senses 
about some world state and uses that information 


to control some situation manually. 


b) Describing systems, when a system's present state 
fPoetsede do. lnput in order to provide direct 
outputs back to the system via some manipulation, 


with the goal of minimizing system error. 


Cc) Evaluating human performance, when performance at 
Simple control of some system is being measured 


and compared with a criterion. 


USED IN LITERATURE: 

a) Bekey, G.A., Burnham, G.O., and Seo, J. UC Ont Eo: 
Theoretic Models of Human Drivers in Gar 
Zorroweng  stili@ean FACtOrS, YVOl. 10, Now 1, i977, 
pp. 399-413. 

Three mathematical models are used to describe 
control behaviors of human drivers. First is 
classical (manual) control, with assumptions about 
the driver's stimulus-response characteristics and 


control strategy algorithms. Second is based on 
optimal control theory, Seles coe a performance 
index and a driver's control strategy intended to 
Minimize this index. Third 1s a set of heuristic 


models. 
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b) Laujee.G.Y- A Review of Human Operator } 
Manual Control Systems. Pacific, “iseiie = 
Center, A ge CA February 1 
(PMTC-TP-76-40, AD BO16 783L). - 

Includes both uaSi-linear describing function 
models and optimal control models. (An extensive 
bibliograpy of manual control models is included. 


by 


Cc) Levison, We. "A Methodology for Quantifying the 
Eifects Get nents on Perceptual-Motor Capability", 
Human FaGeors,eOlec3, Nos a Nai, ee o/=-9 Ge 

e application of experimental and analytical 
techniques of manual control is made, for quanti- 
fication of aging effects in a model of human 
perception and control. 


d) Pew, R.W. et al. Critical Review andi Analysis of 
Performance Models Applicable to Man-Wachine 
ystem Evaluation. BOwae, Berenak and Newman, 
NC. SSeS MA, March 1977 (SBN No. 3446, 
AFOSR-TR-77-0520, AD-A038 597)... 

Simple, quasilinear, and optimal control models 
are among the numerous models reviewed as part of 
this 300-page comprehensive report. 

REFERENCES AND TEXTS: 

a) Rouse, ius Systems NE LS SEBS Models of 

Human-Machine Interaction. New ork>”~ ” New@em 
Holland, T1980. nis ; 
_. ._Theoretical presentation, with some application 
information; greatest emphasis 1s on discrete time 
optimal ccntrol, but manual control also is 
covered. 

b) Sheridan, 1.B., aud Farrell, W.R. Man-Machine 
systems: Information, Contorl, and Desision Models 
OL Human Performance. Cambridge, Hass.: The iv 


Press, 1974, TIS3TC 

Detailed’ theoretical and mathematical presenta- 
tion on manual control, with lesser discussion of 
optimal control. 


G. OPTIMAL CONTROL MODELS 


Te 


PURPOSE OF MODELZTECHNGOUE: Describing human 


behavior in terms of an optimum regulator (well- 
motivated, highly-trained individual, Subject to 
known personal limitations). The controller is 
affected by and affects state variables of a system. 


Given a process to control, constraints on the accu- 


racy with which he may observe state variables, and 
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limited energy or time for control tasks, the optimal 
controller seeks tO Maximize a cost function or 
performance criterion within his own constraints. 
The criterion usually is stated as a linear quadratic 


function of error, control effort, and time. 


MATHEMATICAL TOOLS REQUIRED OR USEFUL: 


a) Algebra 
b) Calculus, single variable, multiple variable 


c) Descriptive statistics 


HUMAN FACTORS APPLICATIONS: 

a) Describing individual differences, when the oper- 
ator 1S considered sophisticated enough to recog- 
nize his own dynamics and the dynamics of the 
controlled process, his own variablility, and the 


GEiteriyvon to be tet. 


b) Describing systems, when the situation is similar 


to that discussed above for the individual. 


c) Evaluating human performance, when actual perforn- 
ance can be compared to optimal behavior as 


described by this model. 


USED IN LITERATURE: 


a) Barron, Sheldon. "A Model for Human Control and 
Monitoring Based on Input Control Theory", Journal 
of Cybernetics and Information Scienze, Vol. 7, 
ow i, ioc, ppe sa-1TS. 

The state variable optimal control model of the 
human operator is reviewed and described in 
detail. Examples of its use in prediction and 
Selo) ERR are presented, along with advantages and 
limitations of the nodel. 


b) Barron, Sheldon, and Levison, W.H. Disp lay 
Analysis with the Optimal Control Model of the 
Mugen eOpemacor”, Human Factors, Vol. 19, No. 95, 
1977, pp. 437-457; j 

the Optimal control model is_applied_in deter- 

mining what information is needed ona display so 

the operator can meet his performance objective. 

The echniques are_ then appre to analysis of 

advanced display and control systems. 


oe 


Cc) 


d) 


e) 


f) 


Harvey, T.R. Appl Meee of an Optimal Control 
PIlot ‘Model =09 fie-wo-Arr. Comod Master's 
thesis, School” EL page t Lele Rir Force Institute 
on “Techno logy, erick Patterson AFs, OH, 1974. 

Two-dimenSional kinematics of air-to-air combat 
tracking with a lead computing optical sight 
system were simulated on an analog computer, using 
a fixed-base simulator. Tracking error data 
values were collected from three pilots, using the 
Simulator. 


Hess, R.A. "Prediction of Pilot Opinion Ratings 
qgr7g an ee Te Db. ES oon TS. Human Factors, Vo 
Ors o- 


De 
duLbaasen eae tasks can be modeled via the 
optimal control formulation with relative ease. 
Wimerical ilot opinion ratings onc ome palezes 
ular vehicles and tasks are related to the numer- 
ical value of the model's index of performance, 
using data from piloted simulations. 


Ince, fuae. Appication On 
to the Design of Man-Machine 
Of Taito See August T3973 (NPS S875 ). 

Results from optimal control theor 
optimal controi model of the human opé@rator are 
used in design of control and display dynamics, 
and in predicting tracking performance. 


Seifert, Dies mbined yoESS crete Vetwork 
Continuous Control Mo sis ing of Man-Machine Systems 
Aerospace Medical Research Tab, ine eee eee 
AFB, H, tas 19 / Seas Ree TR-79-34, AD-AO71 57 4). 

dpen-1loo optimal control nodeis are combined 
with network models to describe the human operator 
as supervisor of a system. Tasks include inforna- 
tion retrieval and cognitive processing, as well 
as Light ContEol. 


28 use, oe Systens Engineerin Models of 
Human-Machine Interact oneamamnte 2 “to EK: Nore 


L 

Holland; t260..) see > 

Theoretical presentation, with some appiication 
information; greatest emphasis is on iiscrete time 
optinal control, but manual control also is 
covered. 
Sheridan, 1.B., and Farrell, W.k- Man-Machae 
3 pstems: ERtQEnaLion, Contorl, and Decision Models 

fuman Performance. Cambridge, Mass.: The Wit 


Press, 1974, T9BT- 

Detailed’ theoretical and mathematical presenta- 
tion on manual control, with lesser iiscussion of 
optimal control nodels. 
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H. 


TIME SERIES MODELS 


a. 


PURPOSE OF MODEL/TECHNIQUE: To assess the magnitude 





and statistical significance of any changes in 
behavior or performance, as a result of an interrup- 
tion (change of conditions) during a series of meas- 


urements over time. 


For example, the accuracy with which an observer 
tracks a symbol on a CRT display can be measured over 
a period of days. The interruption is considered to 
occur when the observer is given a different type of 
display on which the same task will be done in the 
future. Time series analysis is used to determine 
whether any real change in performance (not due to 


Simple learning) is evident, after the interruption. 


MATHEMATICAL TOOLS REQUIRED OR USEFUL: 


a) Algebra 


b) Probability theory 

c) Descriptive statistics 
d) Graphs and plots 

e) Computer packages 


HUMAN FACTORS APPLICATIONS: 





a) Describing individual differences, where the 
differences can be attributed to different 
responses to an interruption ina time series of 


measurements. 


bk) Describing systems, where system performance over 
time is the factor of interest, especially as 


affected by some kind of change in conditiors. 


c) Evaluating human performance, when performance 
Changes may be expected as a result of known 
changed conditions, anda series of measurements 
(before and after) will be made. 
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-_ 


4. USED IN LITERATURE: 


a) 


b) 


C) 


Carter, R.C.w "Time Series Models of Human Factors 
Dynes " Human Factors, Yol. 26, No. 1,  ‘tSiae 
PP the Box and Jenkins multivariate time series 
model is used for analysis of human factors data 


representing U.S. Navy enlistments, career 
progresses of technicians, spatial and verbal 
ime cycles, and simple and choice reaction times. 


Krause, P.B. “The Impact of High Intensity Street 
Lighting on Nighttime Business uae ", Human 
Factors, Vol. GO. 3, 1977, pp. 235-280; ae 

Nn interrupted time series design is used in an 
experiment which demonstrates the “effect of night 
lighting on crime. Hazards that can arise if the 
serial dependence of successive observations is 
ignored also is illustrated. 


Shinners, S.-M. “Modelling of Human Operauan 
Performance Utilizing Time Series Analysis", IEEE 
Transactions on systems, fan and Cybernetics, 
Vol. 4, No. 5, 197%, pp. 446-958. 

The time series approach is a useful method for 


modeilin any .se of discrete observables 
corrupted with noise, . be it human or some other 
deterministic/stochastic process. Actual input- 


output data are used, in this time series model. 
The technique first identifies the model then 
estimates the parameters of the identified model, 
based on the data. ERS el! eee improvement is 
made, by checking the fitted model with data. 


5. REFERENCES AND TEXTS: 


a) 


b) 


Cook, T-D. ; and . Campbell, . Dee 
uasi~£Xx erimentation: Design and Ana tYSis issues 
or Fie settings. Boston: Houghton Mirrlin 


Company, T1979. 

Complete and detailed discussion of the back- 
ground and use of time series models in general 
aud the Autoregressive Integrated Moving Average 
(ARIMA or Box-Jenkins) model’ in particular. 


SOS, Inc. SPSS-X User's Guide. New York: 
McGraw-Hill Book Company, 1983. 

Detailed instructions fOr Carrying out ie 
Box-Jenkins procedure for time series data. SPs 
Updates 7-9 (1981) also includes the Box-Jenkins 

echnique. 
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I. 


FINITE MARKOV CHAINS 


fle 


PURPOSE OF MODEL/TECHNIQUE: Describing possible 


"states" of a system, and predicting the probability 


the system will be in one of these states at some 


time in the future. 





MATHEMATICAL TOOLS REQUIRED OR USEFUL: 


Linear or matrix-algebra 

Probability theory 

Descriptive statistics 

Computer programming (the APL programming 
languaging is especially useful for operations on 


matrices) 


HUMAN FACTORS APPLICATIONS: 


a) 


D) 


Cc) 


Describing individual differences; for example, 
jilustrating the probability that someone will 
transition from one to another of four states 
(asleep, bored, alert, frantic) in the next time 


period. 


Describing systems; for example, noting in concise 
form (matrix) the probability that a system will 
move from one state (OFF) to any one of three 
others (WARMUP, MANUAL, AUTOMATIC) in its next 


transition. 


Evaluating human/system performance; for exanple, 
determining the probability that an individual or 
system will be in a state-of-interest, at some 


given time in the future. 


DESCHeEP TIONS 


Model: A system or process is described: as a 
function of four things: 


a) A finite set of objects (usually one). 


GW 


D) 


ii) A finite collection of possible discrete 


states the objects can be in or assume. 


iii) The initial probability: probability for 


each state that the process begins there. 


iv) The transition probability: probability the 


object will stay in that state or enter 


another state in the next time period. 


Assumptions: 

i) Markov property. The likelihood of entering 
any state in the future depends only on the 
present state the object is in, not on any 
past states (also called the memoryless 
property); that is, 

PU X (n+1)=31X (n) =i, X (a-1) =i (n-1) ,.-. ,X (0) =i (0) J 
=" PUA (0 1) Se eee: re 

for all states 1(0), i(1),.-.,2(n-1), 220n 

and all n20. 

12) Stab ronariiege Transition probabilities do 
not change with time (are "stationary") . 

1ii) Certainty. All states and all transition 


probabiliites used in the model are known 
constants, obtained through some empirical 
data collection process; the system is 
completely characterized by the set of 
states, initial probabilites, and transition 
probabilities. 


c) Strengths: 


1) The procedure is simple to follow, appeals 


to logic, and is easy to defend. 
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e) 


Weaknesses: 


a) 


121) 


i) 


129) 


jii) 


Values for the transition probabilities are 


Crat ical small errors in estimates for 
these can give significantly incorrect 
answers. 


The independence of the probability of the 
next state from that of all past states, 
except the present one (Markov property), 


often does not mirror reality. 


The requirement that states of existence be 
discrete can be difficult to meet, for many 


continuously varying situations. 


Define an exhaustive and mutually exclusive 
set of states the system can assume over 


time (preferably no more than a dozen). 


Taking one state at a time, assign (by what- 
ever means) a probability to the event that 
the process begins in that state, plus 
another probability that it either stays 
there or enters each of the other possible 
states from that state. These latter prob- 
abilities must sum to 1, for each beginning 
state. That is, 1f there are four possible 
States (including the one the system pres- 
ently is in) and the chances are equally 
likely that it will be in any one of the 
four during the next time period, each event 


is given the probability 0.25). 


As the first stage in the modeling process, 


put this information into matrix form, as 
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iliustrated below in 5.c. This is the 
transition matrix, P (also called the one- 
step transition matrix). This transition 
matrix plus the set of initial probabilities 
now (under the model's assumptions) 
completely characterizes the system of 
process--this is the complete model. 


iv) To determine the probability the system will 
be ina given state two steps or. stages 
onward (two time periods ahead), square the 
transition matrix (use matrix multiplication 
tO Multiply 2t Dyeeetseis) to obtain the 
two-step transition matrix, P(ij)?#. Cubing 
the matrix yields the three-step transition 
Matrix, P(ij)3 (the probability the system 
Will be in a given state three time periods 


ahead), etc. 


v) The long-run probabilities (also known as 
steady-state, -stationary,. or equilibriun 
probabilities), 7, are obtained by repeat- 
edly multipiying the transition matrix by 
itself until limiting (essentially constant) 
values for the probabilities are reached (if 
they exist). These represent the long-run 
proportion of time the system will be in 
each of its possible states. These values 
also may be obtained by solving a set of 
linear steady state equations of the forn 


11 Piles. 21 
Ptiay = Ws (62 
p(13) + m7(2)p (25) 
(1n) + 77(2)p (2n) 


A 
ise. 
i 
> 


17 7 
= + I(n) p(nj)- 


rs 7 (n) p(nn) : 


a 
LJ.¢ 
bead 
ti 
| 
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=) 
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| 
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as 
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Values are found for each of the limiting 
probabilities, 7r(l), using a subset of 
(n—-1) of these eguations, along with the 
relationship that the sum of all the 7 (i), 
ae Gee - 78, Gist) equad)1 (normalization 


eguation).- 


f) Qther calculations that may be made, using the 


transition matrix, include the following. See 
references below, nye yw details of these 
Caleuiate TONS. 

i) Probability of first passage time: the 


likelihood the system will enter a specific 
State, t{i), at a future time, given that it 


Started in some specified state, t(j). 


1) Expected first passage time: the mean value 
of the time it takes the system to move fron 
State t(i) to state t(j). 


iii) Expected frecurrance time: the average value 
of the time it takes the system to return to 


state t(1i), when it has been there once. 


iv) Absorbtion probabilities: the probability 
that a system will enter one of its possible 
states and never be able to leave that state 


(be "absorbed" into that state). 


5. ACM EXAMPLE (adapted from Oberle; see below): 

a) Situation: A one-on-one engagement between a 
fighter and adversary. The relative positions and 
orientations of the two combatants are divided 
into five tactically meaningful states (although 
such transitions between states in actuality would 


be continuous, they are discretized here for use 


Ts 


with the Markov property), as follows (see Figure 


6.1): 


i) 


4i) 


1i1) 


iv) 


rab), 


Offensive weapon (OW): the fighter has a 


"rule of thumb" wea pon Opportunity, giving 


him an almost-sure kill opportunity. 


Offensive (0): the fighter is acting in the 
role of pursuer and has a tactisally signif- 


icant advantage in position. 


Neutral (N): both combatants are maneu- 
vering head-to-head in an attempt to achieve 


a poSition of tactical advantage. 


Defensive (D): the adversary is actingaa 
the role of pursuer and the fighter is 
reacting to the adversary's positional 
advantage. 


Fatai defensive (FD): the adversary has a 


= SS. SS aE SS Se ee ae 





Direct (one-step) transitions can occur only 
between adjacent states. At each 5-second 
time division during an engagement, the 
fighter is classified as being in one of the 
five states. Oberle provides the simulated 
data shown in Figure 6.1 for a hypothetical 
115-second exercise (artificially divided 


here into 23 5-second time segments). 


Although Oberle does not do so, the same 
data can also be given in the format of a 
more standard Markov chain model, as is 
illustrated as in Figure 6.2. States are 
Shown aS circles, transitions as arrows, and 


transition probabilities as fractions. 
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Figure 6.1 Transition States During a Simulated Engagement 


111i) One-step transition matrix: Oberle does not 
put his simulated data into transition 
Matrix format, nor does he make any further 
calculations in this report. However, given 

this data, 1t 1S easy to carry out addi- 
tional operations usually performed with 


Markov chains. 


For purposes of this example, it is 
hypothesized that the initial probability of 
being in a neutral position at time 0 is 
Os5;,) tieeprobabilatym@phe fightem will still 
be in that neutral position at the end of 
the first time segment is 0.56 (calculated 
Peeotetme Gata ain Figure 6st or 6.2), that he 
Will be in an offensive position is 0.11, 
qidetnate be wiit be im a defensive position 
S20. 336 


es 
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Figure 6.2 One-Step Transition Diagram for an ACM Engagement 


oo i tO 


Similarly, it is hypothesized that the 
initial probability of being in an offensive 
position at the start of the engagement is 
0.25, and that he will still be in an offen- 
Sive position at the end of the first time 
segment 1s 0.40. This process is repeated, 
with results as shown in the one-step tran- 


Sition matrix: 
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Initial 


prob. oW  O N OD FD 
ow [ 0 flO ani" Omen oo” o | 
o |.25 Onl Oe 2mm O80 
N 1-50 | Pp = n ] 0 -17.56 0-330 | 
D {.25 D1 0 Cees 20 «201. 
FD | 0 FD | 0 0 oO .50 0 





S| ed 


iv) The total probability that the fighter will 
be in an offensive position at the end of 


the first time segment is: 


(encom 40) + 0R50) (On01) = 0.16. 


v) Two-Step transition matrix: 
OW O N D FD 
OW | -40 ta See 0 | 
0 1.16 .58 .19 .07 04 
p2 = " wom .77° .53 .25 a 
D 0 .06 .46 .34 214] 
Fp | 0 eee. 6.35 -35| 


eee ee EEE 


wid) Long-run probability values: 
Tie LORG=Enn spropertion of time the 
fighter aircraft can be expected to spend in 


each of the five states ils: 


OW O N D FD 
m(i) = ] 087 ape 6217 087 
eee | 
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USED IN LITERATURE: 


a) 


b) 


Cc) 


d) 


e) 


t) 


g) 


Bell, 5.1L. Optimal Baysian Estimation of the 
state Of aa Probabilistically bine | 
Memory-Conditional Markov Process wath 
Epplacations to Manual Norse Be ee Doctor of 
ngineerin esis Naval Postgraduate School, 


gs 
September 1977 (NPS T 180049). 1 
First and second order Markov chain models are 
used to describe the decoding of hand-keyed Morse 
code signals. A Baysian solution process is then 
used to find an optimal estimate o the state of 
the Morse process. 


=: == ee Se ge ee ce 


Systems. Master's thesis, School of Engineering, 
Alr Force Institute of Techies 
Wright-Patterson AFB fas 1983 
(AFIT/GOR/MA/82D-7, AD-A127 365). 

A survey and classification of the literature 
relevant to availability, with emphasis on fprob- 
ability density functions of failure times” and 
repair times. Models include those based on 
Markov processes. 


El Shanawani, A.A. Agailabalit of Maintained 


Newnan, R.A., and Tiffany, P.B. "Discrimination 
of Density and Clustering on Four Versions ofa 
Stochastic Display", Proceedings of the 21st 
Meeting of the Human Factors Society San 


Franerscog mcr, 977, oe 1T3- 3 

A two-dimensional Markov rocess is used to 
control the variables, in a.study of the interac- 
tion of two texture variables (density and 
cluster) with two display parameters (posi time 
tea image and adjacency/separation of 
images). 


Oberle, R.A. Air Combat Evaluation: the Reduce 
Dimension Measures. D“S Associates, Escondido 
CA, a ayo tees CSUR Poms 6-2) 

See the above example. 


= (Qu 


Snow, R.E. "Eye Movement and Cognitive-Process 
Research in uropes some Examples fron 
Switzerland," European Science News, Vol. 38, No. 
6, 1984, pp. 2Z3aeZa7. 


Eye movements and fixations, associated with 
problen solving durin Stimulus search and 
processing are modelied as Markov chains to 


predict different eye fixation paths and lengths. 


Thomas, ble We "A Human Response Model of a 
Combined Manual and Decision Task," Lees 
Transactions on Systems, and Cybernetics, 


Man 
Vol. SHC=3, NO. 5, 1973, pp. 478-480. 
A combined Manual and decision. task is 
described in terms of a Markov chain model 
combined with a discrete probability function. 


rh 


Thomas, Pyles Bf n ELLOr i¢6h 
partment of 


Man-Machine Syst 


some Models o 
em Evaluation 


me La) 


Huma 
De 


Juss! 


(ie 78— pecs: a ae et ae University, December 1978 


IRSVAS RS) h072. 838 
Seno eal ai Mar KOw formulation is used to 
aeerine: transitions among @LLOr states. 
Interdecision times are treated aS a renewal 
process. 


REFERENCES AND TEXTS: 


a) Bronson, Richard. Schaum's Qutline, nee ey and 
Problems of Operations Research. New YOLK: 
McGraw-Hill Book Company, 1982. 

brief explanation, with a number of worked 
out — 

b) eee] gran, Glase J. and Derman Cyrus. 
Probabi 1fey Models ahd a8 Lications. flew York: 
qespert et u 


DLisA Ung Con, imc. 
A readable introduc 


eon to ie processes and 
chains. 


c) Ross, S.M. _Introduction to Probability Models. 
New York: Academic Press, 1980. 
pane ey succinct explanation, TT) str iees 
mathematical terms; a high level of mathematica 
sophistication is advised. 





ay Tayler, Heti., amd Karlin, Samuel. An Introduction 
ae Stochastic Modeling. Orlando: Academic Press, 
nee 
Highly — mRathematical explanation; not £Om 
beginners. 


Je POISSOH PROCESSES 


i. 


PURPOSE OF MODEL/TECHNIQUE: Determining such guanti- 





ties as the number of arrivals into a system (or 
tasks that must be performed) over a period of time, 
the expected "population" size at a given time, and 
the probability of any given population size at a 
tae time. Arrivals must be according to an 
Then the number of arrivals by a given time has a 
Poisson distribution dependent on the rate parameter 


and elapsed time. 


For example, a person may be tasked with learning the 


Chinese language. The length of time reguired to 


Pa 


learn any given character is a random variable. Le 
data collection indicates that the distribution of 
this random variable is approximately exponential and 
a rate parameter can be calculated, the learning 
process can be described as a Poisson process. Then 
it is possible to predict such quantities as how many 
characters will be learned in an hour and the prob- 
ability that the student will know 100 characters at 
the end of five hours. 


MATHEMATICAL 2COLS REQUIRED OR USeFuUL: 
a) Algebra 

b) Probability theory 

c) Descriptive statistics 


d) Graphs and plots 


HUMAN FACTORS APPLICATIONS: 





a) Describing individual differences, where the 
differences are a function of some characteristic 
that can be considered in terms of arrivals, with 


exponential distribution. 


b) Describing systems in which events occur with 


time, expressible as an exponential random 
variable. 
c) Evaluating human performance under conditions 


which meet the Poisson and exponential distribu- 
tion requirements of this model. This is espe- 
cially useful in accident and error predictions, 
as is discussed in the section on reliability 


models. 


, F.A.s "A Mathematical Model of Driver 
ess", Ergonomics, Vol. , Now 4, 1972, pee 


A non-homogeneous Poisson process is used to 


velop a model of driver decision making, based 
observations of driver behaviors. 
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REFERENCES AND | | 
Der aetOuwrmnste, and Proscnan, Frank. . Statistica 
Theory ,,of , dotaabsiity and life Testing: 
Probability Models. Silver Springs, Wd., To Begin 
With Press, T3975, 1981. . 
Comprehensive discussion of the use of Poisson 
processes in reliability determination. 


b) Bronson, Richard. Schaum's Qutline, BaeOrY and 
Problems of ee Research. New Oaks 
NcGraw-Hilt Boo Cer ee ic AS2 . 

A very brief explanation. 
ey) Cox, Daku Renewal Theory. London: Methuen and 


So re Ltd. ° 
brief mathematical look at _Poisson processes 
as they relate to reliability and renewal. 


d) Ross, S.M. (Introduction to Probability Models. 
New York: Academic Press, 19 
Complete and thor 
SO 


ough explanation; a high level 
of mathematical 


O 
phistication is advised. 


Sena yuon, dea ., ana Karlin, Samuel. An Introduction 

_ etochaseic Modeling. Orlando: Academic press, 
nes a 

Sood, brief explanation, but not for beginners. 


K. QUEUEING PROCESSES 


a. 





PURPOSE OF MODEL/TECHNI QUE: Determining the length 
of time a customer (person, object, or task) must 


wait "in a line" (in gueue) to get attention, the 
time needed to provide Service or perform the task, 
the number of customers in the system and in gueue at 


one time, etc. 


MATHEMATICAL TOOLS REQUIRED OR USEFUL: 
a) Algebra 

b) Probability theory 

c) Descriptive statistics 


ad) Graphs and plots 
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HUMAN FACTORS APPLICATIONS: 


a) 


D) 


Cc) 


a) 








Describing individual .differences in task 
performance. - 
Describing systems, where these can be viewed as 


consisting of "customers" and “services", 


Evaluating human performance, such as how long it 


probably will take to perform a series of tasks. 


DESCRKEPLTLON: 


Model: A system or process 1s described as a 

function of seven things: 

i) Population size of the arriving customers or 
input source, either finite or infinte 
(usually assumed to be infinite, Since 


Calculations are easier). 


suk, State of the system, that is, the number of 
customers actually in the queueing system at 
a given time of interest, either waiting or 


being served. 


1i1) Atrival patterns, usually specified by the 
j 1 time, the time between succes- 
Sive customers into the systen. More 
complex models may specify single versus 
batGhwarrivaic, and whether customers may 
balk (refuse to enter the system because 
lines are too long), renege (a customer ina 
queue gets tired of waiting and leaves 
before being served), or jockey (move from 
his original line into another that ae 
shorter). Simple models assume single arri- 
vals, and no balking, reneging, or 


jockeying. 
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iv) 


Vv) 


vl) 


Service patterns, usually specified by the 
service time required to serve one customer. 
This can be deterministic (a constant, known 
value), or a random variable with some known 
probability distribution. More complex 
models specify whether a customer requires a 
SSELCS Of SCPVErS OFf1s served completely by 
one server (the usual Simplifying 


assumption). 


Number of parallel servers at the facility 
who provide the needed services for 
customers in the gueue. All such servers 
are assumed to be interchangeable and equal. 


Queue discipline of service discipline, 
which specifies the order in which customers 
are served. Usual orders are first-cone, 
first-served or first-in, first-out (Pao), 
aS with customers at a supermarket checkout 
Seamd "last =-1n, “f£test-out (LIFO), as with 
items in a suitcase; random orjier (RO); or 
priority order (PO), where certain customers 
get preferential treatment. Most commonly a 
service order is not specified, but the 
model is referred to as a general discipline 
(GD) model. 


Kendall's notation, which is simply a stan- 
dardized shorthand for specifying the above 
parameters: 
(3Ah/Z) : (U/V 7m). 
X is the interarrival time distribution 
and Y the service time distribution. These 


usually are denoted as M (for Markovian or 


oS 


exponential), 0D (for deterministic),  E (k) 
(for Erlang), or G (for general). | 
Z is the quantity of parallel servers. 

U0 represents the service discipline. 

Vand W indicate the system capacity and 
size of the task population, respectively-- 
both often infinite in size (@). 


b) Assumptions: The first four assumptions are 


common for most queueing problems. The last seven 


assumptions will be made for this study, in order 


to keep the model at its most basic, easy-to- 
follow level: (M/M/1): (GD/00 /co). 


1) 


il) 


iii) 


iv) 


v) 


Stationarity. Arrival time and service time 
probabilities do not change with time (are 


Weta Elonany jm 


Certainty. The population size, system 
capacity, and nunbexsof servers used i025 
model are known constantsS-—-have been enmpiri- 


cally determined in some manner. 


Homogeneity and eguivalence. Customers, 


servers, and service all are homogeneous. 


It makes no difference who serves whon. 


Non-negativity. All variables are none 
negative (exist in quantities greater-than- 


or-equal-to zero). 


and service times (also known as Markovian 
or Poisson processes). It is a property of 
this probability distribution that the 
arCival time of the next customer is inde- 


pendent of when the last one arrived, and 
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vi) 


Vil) 


viii) 


Ie) 


x) 


Xi) 


that the expected time for completion of 
service is independent of how long the 
customer already has been in service (meno- 
ryless property or Markovian property). 


Single events. Time increments under 
consideration are small enough that the 
probability is approximately zero that two 
oc more events will occur in one time incre- 
ment (two arrivals, one arrival and one 
service, or two services). There is, 
however, a positive probability of either 
one arrival or one service during any time 


increment. 


eneral gueue discipline (GD), with a single 


¢ 


Infinite population size and 


capacity, at least as an approximation. 


Simple arrival patterns. Customers are not 


allowed to balk, renege, or jockey. 


Underutilization of servers. Server occu- 
pancy or utilization is not perfect. ae 
servers are always busy (100%), waiting 
lines slowly will become infinitely long. A 
useful rule of thumb, according tc Rouse 
(see References and Texts), is that servers 
are occupied 70% of the time, for an effi- 


cient systen. 
Steady state conditions. The system has 
been in operation long enough to have 


reached equilibriun or steady state 


behavior. That is, we are not considering a 


3) 


Cc) 


d) 


1) 


11) 


i Pah) 


new queue just forming when a store has just 


opened for the day. 


The procedure is applicable to a wide 
variety of problems which can be viewed as 


having "waiting line"-type characteristics. 


Qualitative and approximate guantative 
answers to a number of questions of interest 
about af given queueing systen can be 
obtained via this relatively simple model. 


Using advanced mathematics and a computer, 


large and complex problems can be solved via 


sophisticated queueing model techniques. 


Weaknesses: 


i) 


ii) 


stably 


iv) 


For the model to remain simple and easily 
tractible, both ainterarrival times and 
service times must follow an -exponential 
distribution--a condition not always easy to 


justify in the real world. 


The model requires that customers (tasks) be 
handied serially; yet, in many situations, 
Simultaneous attention often is necessary to 


accomplish agen. 


Many queueing problems are analytically 
intractible, and require both approximation 


and simulation to obtain even rough answers. 


The non-equilibrium situation is especially 


difficult to deal with, limiting the useful- 
ness of the model to on-going, nature 


processes. 


86 


e) Procedures: The example that follows illustrates 


the process in more detail. 


i) 


ii) 


tea) 


iv) 


Determine that interarrival times and 
service times are approximatly exponential 
random variables, from available data (see 
Figure 6.3 in the example). Note the values 
of the mean time between arrivals, A, and 


the mean Service time, p[. 





Also determine that other parameters of the 
Situation may approximately be modeled as an 
(M/M/1):(GD/O0/oo) system. That is, there 
Should be a single server, the service 
discipline should be general in nature, and 
the customer population and number of 
customers allowed in the system should be 


very large, if not actually infinite. 


Decide what the state of the system, hn, is 


likely to be at the time the modeling 
process begins. What guantity of customers, 
either waiting or being served, are already 


in the system? 

The guantities that will be calculated are: 
Server occupancy or server utilization, 
Pp = A/p - 


Probability the system will be in state n, 
P(n); 
iene 2, 2 (2) = p= (1 —- eee 

Average number of customers in the systen, 


L = @7(1-9p )- 


Average number of customers in gueue, 


ea pees {i - Pp) - 
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Average time a customer spends in the 
systen, 
© = 17 Choe 


Average time a customer spends in queue, 
Wq = P/(U-X)- 


Probability a customer spends more than t 
units of time in the systen, 
W(t) = exp (-t/W). 


Probability a customer spends more than t 
units of time in queue, 
Wq(t) = Pexp (-t/i). 


v) Three other equations may be used, ie 


desired, for calculations: 


W= Wq + 1/y. 
ST 
Lg = A Wq. 
f) Other calculations that may be made: Queueing 


models considerably more complex than the one 
illustrated here have been used to obtain answers 
to questions similar to those described above (and 
illustrated below), when a Simple model is not 
applicable. See the various authors cited under 


References and Texts for details. 


5. MILITARY EXAMPLE (hypotheticai) 


1) A fighter aircraft is ingressing toward a 
fixed target, crossing hostile territory. 
Various enemy ground-based radar systems 


illuminate the aircraft from time to time, 
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Figure 6.3 Exponential Distributions for Arrivals and Service 


with time distribution approximately that of 
an exponential random variable with rate 
A = 1/2 per minute (2 minutes average 
tine between threats). Prodro. 653 2ilas= 
trates this distribution. 


11) Warning that he is being illuminated bya 
threat radar is provided to the pilot on his 
radar warning display (RWD). He must take 
some kind of defensive or deceptive action 
when this occurs: drop chaff or flares, jam 
the radar, . or make jinking maneuvers with 
hasmoarcratt.. The time reguired to take an 
appropriate action also approximately is an 
exponential random variable (Figure 6.3), 
With rate UU = 2 per minute (0.5 minute or 


30 seconds average time to take an action). 


eo 


iii) At time zero (the start of the scenario 
being modeled), the aircraft will be consid- 
ered to be in a steady state condition, 
Since it has been behind enemy lines for 
five minutes. One radar system presently is 
illuminating the aircraft, and no defensive 


maneuvers are underway. 









! 
Source of 
Customers 
Customer 
In . 
Departing 
service Customers 
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—_- 
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Figure 6.4 Illustration of Single Server Queueing Systen 


b) Procedures: 

i) This model can be specified as 
(M/M/1) 2 (GD/ a0 /co ) Both the interarrival 
times and service times are 2xponentially 
Gistributed (Markovian). There is a single 
server (the Biol in Gums ag ay an infinite 
"Customer" population (the enemy radars), 
and an unspecified (presumably infinite) 


Rumber of customers allowed in the system. 
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aim 18) 


le) 


iv) 


v) 


vi) 


No particular service discipline is speci- 


fied, so it will be considered "general". 


A sketch of this very simple system is shown 


in Figure 6.4 


To perform the desired calculations, we 


first note that: 


Arrival rate A 1/2 per minute. 


Service rate MM = 2 per minute. 
Number of servers c = 1. 
State of the system n = 1. 


The "server occupancy", Pp + 1S a rough 
measure of the pilot's workload. in ens 


steady state condition, 
een i= A divided by 2 = 0.25. 
Thus we see that, on the average, the pilot 


is spending 25% of his time responding to 
threats. 


The probability of the system being in the 
state where n= 1 at any given time (that 
is, where exactly one threat is present) is 


given by 
P(1) = p!(1-p) = (0.25)1(0.75) = 0.188. 


That is, there is less than a 20% chance of 


this state occurring at any specified time. 


The average aumber of threats illuminating 


the aircraft is given by: 


L= P/(1- Pp) = (0.25)/(0.75) = 0.333. 
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VA) 


Vian 


1x) 


The average number of threats "in gueue", or 
illuminating the aircraft and not yet count- 


ered, is: 
Lg = pest" ~p) = (0.25) 2/(0.75) = 0.083. 


The average time a threat will illuminate 


the aircraft is given by: 


W = 1/7( pp -A) = 17(2 = 1/2) = 2/3 = Cleese 


minutes. 


The average time a threat will illuminate 


the aircraft before it is countered is; 


Wq = p/( M-A) = (0.25)/(1.5) = 0.167 


Minutes. 


The probability that a threat will illuni- 
nate the aircraft for longer than one ninute 


is: 
W(t) = exp (-~t/hi) 
W(1) = exp (-1/W) = exp (-1/(0.667) = 0.223. 


The probability that a threat will illumi- 
hate the aircraft for longer than a minute 


before it LS countered is: 
Wq(t) = p exp (-t/¥) 


Wq (1) = (0-25) exp (-1/0.667) = 
(0.25) (0.233) 5-0 2056. 


The other three equations may be used to 


check our work: 


OZ 


6. 


= 
ll 


Wq + (1/p) = 0.167 + 0.5 = 0.667. 


L = AW= (0.5) (0.667) = 0.333. 


Lg = Affg = (0.5) (0.167) = 0.083. 


USED IN LITERATURE: 


a) 


b) 


Cc) 


d) 


e) 


Carbonell, Jigh. allt Queueing Model of 
Many-LInstrument Visual Sampling" ee 5 
transactions On, Human Factors in Electront Sy 


HPE~-a9 No. S,61966, pp. 157=T6a. a = 


GCarponcll, Joke, NatdgeJ.L., and Sanders, J.W. "A 
Queueing Model of Visual Sampling: Experimental 
Validation" TEEE Transactions on Man-Machine 
Systems, MMS-9, No. 3, 1968 oe IA eg 

he instrument scanning behavior of pilots was 
studied, anda auee Lad model developed to predict 
the fraction of time devoted to each instrument. 
The model later was compared with performance of 
three pilots flying. simulated airport approaches, 
and compared well with observed performance. 


Eltermann, L.J. | Computer Simulation Design, 
Development and Validation. Mitre Corp., Bedford, 


L 
HA, June T1982 (MTE-8416, AD-BO67 Y977L). 
_SIMSCRIPT is used for a discrete-event queuein 
Simulation of a communications system contro 
system, . as part of system support analyses of 

Man-machine resources within a computer system. 


Groves, A.W., and Kaercher, R.l. 1D on 
Ba Se Pilot Workload in an. ierO-Openea , 
Night, Low-level Environment. Air ce Institute 
of AEG) Te OT Wright-Patterson AFB, OH, March 
1981 (AFIT/GST/0S/81M-5, AD-A101 138). _ 

_A time-sequenced network of required tasks, 
with ge Osea servicing by a single server, is 
used to model 30 minuteS of visual navigation and 
terrain following, incorporating 20 tasks. 


Simulation to 


Semidw,  D.k. "A Queueing Analysis of the Air 
TEaiiac Controller’ setork iowa", SELEEE Transactions 
on _ Systems, Man, and Cybernetics, SNC-8, Wo. 6, 
13.5 pp 492=75 3° 

queueing theory formulation was used to 
analyse the workload of air traffic controllers. 
The model was then used to predict average delay 
and server occupancy as a function of demand. 


Taguehi, K, and Murotsu, Y. "Simulation Studies 
of Evacuation of Passengers and Crews on Board," 
Pepomonmases, VOL. 20, NO. 3, 1977, p 329. 

Queueing models are applied to the flows of 
passengers from doorways and exits, to determine 
Selection of passages and widths of passageways, 
based on delays of the flows and evacuation times. 


| 


£f) Wichansky, A. Mi. "Human Factors Aspects of 
Pigment A Critcal Review", Human Factors, Vous 
8, Nos 2,29 ooo ee 
_ A general look at queueing theory and its use 
eee customer behavior and human waiting 
ehavior. 





a) Bronson, Richard. Schaum's Qutline, ce and 
Problems of perations Research. New OrK? 
HcGraw-HilT Book Company, 1982. — ’ 

Excellent, clear introduction to queueing 
systems and (M/M/1) queues, plus separate explana- 
tion of more complex models and how to use then. 


b) Daellenbach H.G. and others. Introduct ienees 
Operations Research Technigues Second Edition. 
oston: Allyn & Bacon, Inc., 1983. ; 
Simple models are lossed. over; heavier reli- 
ance of seretenaees erivations than is usual in 
is text. 


c) Hiilier, F.sS., and Lieberman, G.lL. Introd uctaan 
to Operations Research. San Francisco: 
Holden-= a7 7 lnG.oou. ' ; ; 

oe emphasis on exponential distribution, but 
no simple explanation of how to use the simple 
models to find answers. Detailed discussion of 
mathematical derivations and manipulations. 


d) Ross, S.-M. (Introduction to Probability Models. 
New York: Academic Press, 1980. 
_ Succinct explanation in mathematical terms, 
with no numerical examples provided. 


e) Rouse, W.B. Systems Engin 
Human-Machine Interaction. N 
Holland, T9380. 
. Considers queues of tasks, and queueing theory 
is used to predict human performance at conpi ere 
tasks. However, Simple models are glossed over, 
and great detail as given to one rather complex 
model of flight management. 


£)eNagne rssh Principles of Operations Research. 
New Jersey: Prentice-Hall, Inc., : 
Excellent, clear introduction to the subject, 
and to the ot pone dastiLaowecon Lamily. lear 
explanation of more complex models, also. 
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L. 


RELIABILITY MODELS 


a 


PURPCSE OF MODEL/TECHNIQUE: Estimating expected time 
of failure, probability of failure ina given time 
period, etc., for a given system with known failure 


rate (or survival rate) distribution. 


For example, data collected on frequency of misinter- 
preting information on a given CRT display format nay 
indicate that time between errors iS a random vari- 
able that closely fits an exponential jJistribution, 
with rate A = 2 per hour. Given this, we can use 
properties of that distribution to make calculations. 
On the average, the mean time to failure will be 1/A 
= 1/2 hour. The probability that no failure will 
occur in the first 15 minutes is the exponential 
survival function, exp(-At) = exp(-2 X 0.25) = 0.61. 
Probability of no failure in 1/2 hour is 0.37, in 1 


hour is 0.14, etc. 


MATHEMATICAL TOOLS REQUIRED OR USEFUL: 


a) Algebra 


b) Single variable calculus 


~~. 


Cc) Probability theory 
d) Descriptive statistics 


e) Graphs and flots 


HUNAN PACTORS APPLICATIONS: 
a) Describing individual differences, as related to 


accuracy and errors. 


b) Describing systems, and predicting how long we 


expect them to perform. 


Cc) Evaluating human performance over a long period of 
time, based on measured failures/errors during a 
shorter data collection period which can be used 


to develop a model. 
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USED IN Late Age. 


a) 


D) 


Cc) 


qd) 


e) 


f) 





Askren, W.B., and Regulinski, T.L. eats eae 
Human Performance or Reliability regener O 
Shes Hee Human Factors, Vol. 11, No. 4, 15969) "eam 


A general mathematical model of the probabilit 
of errorless human performance was derived, an 
equated to human reliability for time-continuous 
tasks. Weabull gamma, and log-normal density 
functions were determined to be felevant descri- 
bers of the data. 


Meister David. Comparative Analysis of Human 
Reliabilit Models. Bunker-Ramo Corp., November 
TI7T. (LOG 74=T07, NPS U 147484). 


A total of 22 models were analysed to evaluate 
their ability to predict performance of humans in 
Operating and Maintaining military systems. 
Simulation models were found more powerfu than 
analytic. models. ena usually consisted of 
probability of successfu task/system performance 
and completion time. 


Meister, David. "Methods of Predicting Human 
Reliability in Man-Machine Set ens « Human 
Factors, Vol. 6,. 164; ee 621-646. 

A Simple multi reat 


t ive eee TY, model for 
human error prediction 1s reviewed and evaluated. 
Performance reliabilities for task elements are 
progressively combined through the use of the 
series product rule, _to yiel reliability estas 
mates for tasks, mission phases, and the overall 
system. Altman's Data Store is used to obtain the 
eiemental reliability values. 


Naval Sea Systems Command. Human Reliability 
Prediction System Jser's Manual. Washington, 
D.C., December T3977 {AD=AU58 668). 


Both human and equipment mean-time-before- 
failure and mean-time-to -repair values are used 
in predicting and demonstrating system effective- 
ness and for predicting human reliability, ina 
weapons system environment. 


Pew, R.W. et al. Critical Review and Analysis of 
Performance Models Applicable to Man-Machine 
system Evaluation. Bolt, Berenak and Newman, 
ines Se ES MA, Maren 1977 (BBN No. 3446, 
AFOS R-TR-77-0526, AD-A038 597). 

itman's Data Store and other data Janke 
models of human reliability _are surveyed and eval- 


uated as part of this 300-page ‘Comprehensive 
report. 

Pollard, D., and Cooper, M.B. "An Extended 
Comparison of Telephone Keying and Dialing 
Perrormance", Ergonomics, Vol. 21, No. 12, 1979; 
Pe 


The reliability of office workers pert or 
dialing and keying tasks was investigated. n 


916 


exponential curve was found to be a good fit for > 
keying error data. 


g) Siegel, A.I., Wolf, J.J., and Lautman, M.R. "NA 
Family of Models for Measuring Human Reliability" 
Proceedings of the 1975 Annual Reliability and 
BAS a eee Symposium, [EEE, Washington, UC, 

73, eRe a mr. a is ° . 5 

A set of stochastic, digital simulation models 
for human performance in .Man-machine systems 1S 
described. One of these will yield predictions of 
integrated system reliability, considering both 
equipment and human performance. 





REFERENCES AND TEXTS: 
a) Bamwlow, Keg. and P chan Prank. Statistical 
; Theory ‘oF’ petiabilicy ” and Life> “testing? 
Probability Models. Siliver Springs, Wd., To Begin 
With Press, 1975, 1981. 3. — 
Probabilistic Uae ye nasa s of reliability 
determination; very complete; mathematically 
sophisticated. 
Dy Cos, Dak. Renewal Theory. London: Methuen and 
Gone he. ieee ae ; 
rief succinct mathematical text on the 


renewal aspect of reliability. 


M. SIHULATION MODELS 


1. 


PURPOSE OF MODEL/TECHNIQUE: Building an experimental 
model of a system when uncertainties, dynamic of 
compiicated interactions, and interdependence among 
variables makes the development of an analytical 
model difficult or impossible. The simulation model 
then can be used with a computer to @valuate and 
compare specific alternatives, and 1mxe) make 
predictions abcut the system. Simulation can be 
considered the laboratory or experimental arm of 


operations research. 


MATHEMATICAL TOOLS REQUIRED OR USEFUL: While any of 
the following may be needed for a given simulation 
model, only logic and set theory, descriptive statis- 


tics, experimental design, computer programming, and 
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computer software packages will almost always be 


required. 


a) 
b) 
Cc) 
d) 
e) 
f) 
g) 
h) 
1) 
3) 
k) 


1) 


Algebra, simple, linear, Boolean 

Geometry, plane, spherical, analytic 
Trigonometry 

Calculus, single variable, multiple variable 
Logic and set theory 

Fuzzy set theory 

Probability theory 

Statistics, descriptive, inferential 
Experimental design 

Graphs and plots 

Computer programming (in languages such as 
SIMSCRIPT, GPSS, etc.) 


Computer packages 


HUMAN FACTORS APPLICATIONS: 


a) 


b) 


Cc) 


Describing individual differences, where the indi- 
vidual is considered in more detail or complexity 


than can be handled through simple analytical 


models; examples include the Computerized 
Accomodated Percentage Evaluation model (see 
BLtt ner), ~ and Computerized Biomechanical 


Man-Machine Model (see McDaniel), both anthropome- 


tric descriptions of humans. 


Describing systems, where the systems are dynanic 
in nature Or where variables are known to 
interact; examples include describing a han- 
machine system during an air intercept mission 


(see Meldrum). 


Designing systems such as control panels (see 
Bonney and Williams), workspaces (see McDaniels), 
task allocations (see Parks and Springer), and 


individual tasks (see Wortman and others). 
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d) Evaluating human performance such as that observed 


in complex crewstations (see Strieb and Wherry). 


4. DESCRIPTION: 


a) Model: 


A system or process is described as a 


function of ten things: 


1) 


ilisls) 


ira 2) 


iv) 


v) 


The system itself, which has dynamic 


phenomena--inputs, components, behaviors, 


and outputs--that are being studied. 


Entities or elements of the syster- 
components whose behaviors are traced 
through the system or time Pet Foden Or 
interest. Classes of entities can be 
concrete or abstract, and include people, 
Machines, various objects, signals, bits of 


data, and tasks. 


Attributes of the entities--size, quantity, 


requirements, responses--that characterize 
their behaviors in the systen. Attribute 
values can be numerical or can be word 
descriptions (responses can be verbal, hand- 


written, keyed, etc.). 


Membership relationships of entities, such 
aS Shared attributes which cause them to 
belong to sets or files (temporarily or 
permanently). Files also may have attri- 
butes, such as capacity or a finite useful 


life. 


Activites related to the entities: dynamic 


operations which entities can perform or 
which can be performed upon them. 
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v1) 


vil) 


States of the entities and of the system as 
a whole: the configuration at a given foint 
in time which has been defined by file or 
entity attributes and ongoing activities. 
The initial state iS a special case which is 


defined by the experimenter at the start of 


the simulation. 


Events, which describe any change in the 
state of a system and which result in its 
dynamic behavior. Events can be exogenous, 
the result of some occurance outside the 
ites of the system's own entities. If aime 
events result either from constant exogenous 
inputs or from deterministric endogenous 
consequences, the simulation is cailed 
deterministic that is, the same set of 
inputs always will result in exactly the 
Same Simulation outputs. If events result 
from inputs that are subject to randon 
phenomena, this 1S considered to be a 
stochastic Simulation or a Monte Cario simu- 
lation. Randomness in the initial values of 
entity attributes, in changes in attribute 
values, or in the timing of events can be 
provided through inputting of random numbers 
representing the probability distribution 
most appropriate for the system under study. 
As a result of this randomness, simulation 
outputs will differ from run to run 
reflecting that specified probability 


distribution. 
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viii) Time representation, as the system 


Xx) 


progresses through the events of interest. 
Fixed-time increments (also known as time- 
step incrementation) can be used if events 
occur on a fairly regular basis, so that 
there are not long periods of inactivity; in 
this case, time elapses period by period 
(second by second, Or day by day). 
Variable-time incrementing (also cailed 
event-step incrementation) is used if many 
time periods wiil contain no activities. 
This kind of program progresses according to 
an event list, which governs the progress of 
the program in much the same manner as 
seconds or days would--except that the 
length of periods is not a constant. This 


latter type of programming reguires more 


skill than does the Simpler time-step 
incrementing. 

Decision rules or operating rules, which 
provide logical links between entities, 


activities, events, and resulting states of 
the systen. To use computer jargon, stg 
certain entity and activity requirements are 
met, then a specified change of state will 
occur, else the system's state will remain 


unchanged. 


A flow diagram or algorithn. This is a 
useful tool which depicts the orderly and 
logical flow of events as a series of boxes 
and arrows, covering the sequence or tine 
period of interest. The above-noted systen 
parameters are described in that diagram 


(see Figure 6.5). 
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b) Assumptions: Simulation models vary widely, 


depending on the system being modeled. AS a 
result, assumptions must be made on a case-by-case 
basis (and should be clearly stated for each 
model) . However, the following three assumptions 
probably apply to most such models. 


a) Algorithm validity. The flow diagram 
describing the systean, used for developing 


the computer program, is an adequate repre- 
sentation of the real system for obtaining 


useful resuits. 


ii) Known constants. All constant parameters 
used in the model are known values, obtained 
through some empirical data collection 


process or through logical deductions. 


iii) Known probability distributions. 
Randomly-distributed events can be 
adequately characterized by known discrete 
or continuous probability distributions; 
values for these distributions can be 
obtained for use in computer runs by means 
of mathematical transforms of values 
obtained from a random number generator. 
For many simulations, the assumption is made 
that the individual observations of the 
variables (variable values obtained for use 
in the simulation) are independent (uncorre- 
lated) and are drawn from a single normal 
(Gaussian) distribution with constant mean 
and standard deviation. A second popular 
distribution is the exponential distribu- 


tion, for which the same assumptions of a 
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constant mean and independent values are 


hNade. 


c) Strengths: 


1) 


wE25) 


15) 


liv) 


Simulation technigues can be used for prob- 
lems which cannot be handled through anaiyt- 


ical modeling technigues. 


Simulations provide a means of experimenting 
with proposed systems before they actually 


are developed and implemented. 


Simulation models do not reguire as great a 
degree of abstraction, simplification, and 
approximation as do analytical models; sinu- 
lation models may be fairly true representa- 


tions of the real world. 


The procedure of preparing an algorithmic 
flow diagram is a very useful tool in 
designing a model which represents a systen 
adequately; the orderly thought process 
required can aid the experimenter in picking 


up flaws in his logic. 


d) Weaknesses: 


= ee ee a 


am) 


Simulation cannot be used to find the "best" 
solution for a system problen. Rather, it 
1S an aid to analysis which can be used to 
compare various alternatives--but does not 
find a better one if the experimenter has 
not already thought of it. Optimization is 


done via trial and error. 


Simulation models must include a great deal 
of detail in order to be successful repre- 


sentations of a system. : Thus model building 
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iii) 


liv) 


Vv) 


vi) 


effort is much greater than for an analyt- 


ical nodel. 


The answers resulting from stochastic sinu- 
lation must be considered estimates, and are 
subject to Staerctical Jearor. A large 
humber of Simulation runs are necessary in 
order to achieve statistical Significance 
(Similar to other forms of experimentation). 


Simulation models, being complicated, 
frequently can eat up computer time at an 
enormous rate. Large numbers of runs can be 
required to validate that the model behaves 
like the real systen, to estimate model 
responses to various parameter settings, and 
to determine relationships among these 


parameters. The process is expensive. 


Although many Simulation studies concern 
investigation of systems welsh operate 
continually in a steady-state condition, 
Sinu lation models cannot operate 
continually; they must start and stop. The - 
performance of the simulated system cannot 
be representative of the real one until it 
essentially has reached a Steady-state 
condition, through many runs. This makes it 
especially difficult to use these models to 


predict steady-state behavior. 


Selection of values for starting conditions 
(initial states) is important in determining 
how soon a Simulated state similar to the 
real system's steady state is achieved. Yet 


estimating such values with an adequate 
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e) 


Vii) 


degree of accuracy - can be impossible-- 
indeed, may be the purpose for which the 


Simulation is intended! 


The assumption of statistically independent 
random observations from a given probability 
distribution often is not correct, when 
modeling the real world. For example, the 
waiting time of one customer in a queue is 
definitely dependent on the waiting time of 


the person ahead of him in line. 


Procedures: Not all of the procedures listed nere 


will be appropriate for any one simulation nodel; 


the user must pick and choose according to what 


the system actually is like. 


i) 


ae} 


iv) 


Define the system of interest, setting 
limits on just what portions will be modeled 
and to what degree samplification and 


approximation will be allowed. 


Specify the classes of entities to be 
included, and enumerate the entities 
themselves. 


Assign attributes to the entities, including 
only those attributes which are appropriate 
for this system and this degree of systen 
representation. Give a range of allowed 
values for each attribute (numerical or 


Otherwise descriptive). 


Determine the relationships among the 
entities--what similarities do they have, 
and how does a change in one affect another? 


Identify appropriate sets or files into 
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v) 


vi) 


viii) 


13) 


x) 


which entities will fall during the 


simulation. 


For each entity, define what activites it 
will be allowed to perform, ani what opera- 


tions can be performed on it. 


Define the allowable states for each entity, 
and specify the initial value which will be 
used for the state of each entity. 


Determine the events which will occur during 
the simulation process, including both those 
that are exogenous and those that are 
endogenous. Ascertain which events are most 
appropriately represented as deterministic 
inputs and which are better modeled as 
stechastic 1nputs- For stochastic values, 
decide what probabiity distribution will be 
used to generate those values. Find the 
correct mathematical transform formula to 
convert randomly-generated numbers into 
values of that probability distribution (for 
inverse transformations, see Daellenbach and 
others, p. 469; Hillier and Lieberman, pp. 


6505" OEn “Magner, p. 930) 


Decide whether fixed-time or variable-time 


incrementation will be used. 


Prepare the set of decision rules which will 
be used in the progran. These should be 
based on the entities, attributes, relation- 


Ships, activities, and states of the systen. 


Design the experiment which is to be run via 


Simulation. This includes D Oitah the 
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xe) 


X11) 


Beds) 


aby.) 


selection of the constants, independent 


.variables, and dependent variables, and also 


determiniation of the statistical procedures 
which will be used to evaluate experimental 
results. Use Of Statisties 1 analysis 
computer packages {SAS, SPSS, etc.) can be 
very helpful. 


Draw an ‘algorithmic flow diagram describing 
the system and the process it will go 


through during the simulation runs. 


Write a computer program for the algorithn 
(or have it written by someone who does that 
for a living). Use of one of the specially- 
designed simulation languages cS ng hy 
recommended (SIMSCRIPT, GASP, SIMULA, GPSS, 
etc.). For some Simulation problems, canned 
software packages may already be availakie 
(for human factors use: SAINT, HOS, CAPABLE, 
COMBIMAN, Ciets, CtGu; see literature 


references at the end of this section). 


Using the values of the independent vari- 
ables previously decided upon in the 
computer progtan, run the simulation to 
validate its ability to represent the svsten 
being modeled. Modify the program, if 
necessary. Once the model is validated, 
continue the runs until the desired degree 
of precision is reached for the resulting 
dependent variables (for a stochastic 


Simulation). 


Use the pre-selected statistical evaluation 


techniques on data obtained fron the 
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Simulation runs to determine if results are 
statistically significant, etc. Sensi tiwag, 
analysis also iS especially important here, 
to determine which variables are the crit- 


ical ones. 


f) Qther calculations that may be made: The variety 
of purposes for which simulation models are being 
used in the human factors field is illustrated 
below in the literature references. Other uses 
certainly will be found, as human factors engi- 


neers become familiar with simulation technigues. 


MZLITARY EXAMPLE (adapted from examples in Hillier 
and Lieberman, and in Wagner; see References and 
Texts) 
a) Situation: 
2) Essentially the sane Situation will be 
modeled here as was described in Chapter 6, 
Section H., Queueing Processes. However, 
interarrival times and service times will be 
assumed to follow a uniform (Sguare) prob- 
ability distribution rather than an exponen- 
tial one. Thus, queueing model calculations 


cannot be made in the usual way. 


11) A fighter aircraft is ingressing toward a 
fixed target, crossing hostile territory. 
Various enemy ground-based radar systems 
illuminate the aircraft from tine to tine, 
with time distribution approximately that oz. 
a continuous uniform random variable with 
range 6 to 24 seconds (average time 15 


seconds). 
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aaa) 


iv) 


Warning that he is being illuminated bya 
threat radar is proviied to the pilot on his 
radar warning display (RWD). He must take 
some kind of defensive or deceptive action 
when this occurs: drop chaff or flares, jan 
the radar, or make jinking maneuvers with 
his aircraft. The time required to take an 
appropriate action also approximately isa 
continuous uniform randon variable, with 
range 1 to 19 seconds (average time 10 


seconds) . 


At time zero (the start of the scenario 
being modeled), the aircraft will be consid- 
ered to be in a steady state condition, 
Since it has been behind enemy lines for 
five minutes. No radar systems presently 
are illuminating the aircraft, and no defen- 


Sive countermeasures maneuvers are underway. 


b) Procedures: 


ii) 


The system of interest will be defined as a 


Single-server queueing systen. 


There are two classes of entities: radar 
illuminations (threat warnings), which are 
the “customers", amd aircraft pilots (the 
"“Servers"). There is only one entity in the 
Class of pilots: the single pilot of our 
aircraft of interest. The class of threat 
warning entities is infinite in size, with 
entities considered all eguivalent, and 
identitifed only by the seguence of their 


arrivals. 
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Figure 6.5 Flow Diagram for Simulation Model 
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iii) 


ae) 


v) 


Vi) 


Via) 


Threat warning entities have only one attri- 


bute of interest for this study: their 
interarrival times. As previously noted, 
these are considered to be uniformly 


distributed, with range 6 to 25 seconds. 
The pilot also has only one attribute of 
interest: his countermeasure response times. 
These also are uniformly distributed, within 


a range of 1 to 19 seconds. 


Relationships between the entities that are 
of interest to this study are: (a) a threat 
warning must preceed a pilot response, and 
(b) a threat warning will not go away until 


the pilot has responded to it. 


Activites of the two entities will be 
limited to the following: (a) a radar illu- 
Minaticn will result in a threat warning to 
the pilot, and (b)the pilot will take a 
defensive countermeasure action which will 
result in disappearance of the threat 
warning (and presumably supression of the 
threat). 


Allowable states of the radar 1liuminations 
are (a) absent, or (b) present. Allowable 
States for the pilot are (a) free, or ({b) 
busy. 


Only two kinds of. events will occur: (a) 
acrival of radar illumination threat warn- 
ings, as stochastic inputs, and (b) comple- 
tion of a defensive maneuver by the pilot, 


also as a stochastic input. 


viii) Time incrementing for this example will be 


ix) 


x) 


Xi) 


done uSing the event-step procedure for 


variable time increments. 


Two decision rules may prove useful in 
programming this situation: (a) If the pilot 
is free when a threat warning arrives, then 
the threat iS countered, else the threat 
joins the queue; (b) If a pilot countermea- 
sure is completed when at least one threat 
is in queue, then the next threat will be 


countered, else the pilot is free. 


The experiment to be performed for this 
Simulation is to determine the percent of 
time the pilot will not be able to complete 
hiS misSion, given theSe circumstances. Tete 
will be assumed that "mission completion" 
will be equivalent to "no more than two 
threats in tne system at any one time" (an 
extremely Simple definition, but one that 
can be tested and measured). A "mission" 
will be considered to be one complete cycle, 
or that period of time between queues: a new 
mission Wwili be started (for testing 
purposes) each time the number of threats in 


the system drops to zero. 
The statistic to be calculated is: 
Expected % of mission failures = 


100 X no. of cycles containing 3 threats 
a Seige ; 


An algorithmic flow diagram of the system of 


interest is shown in Figure 6.5. 


dak 


5. 


X1i) 


xiii) 


Xiv) 


One-digit random numbers can be used to 
generate the random observations from the 
two uniform distributions. If random number 
0 is drawn, this will represent an interar- 
rival time of 6 seconds, or a service tine 
of 1 second; 1 will give an interarrival 
time of 8, or a service time of 3; 2 will 
give an interarrival time of 10, Or 4 
service time of So. and so on, incrementing 
interarrival times by twos, Up tO sseandon 
number 9 representing 24 seconds, and incre- 
menting service times by twos, up to randon 


humber 9 representing 19 seconds. 


Although a computer program could be written 
to perform the reguired simulation (and 
certainly should be, if enough runs are to 
be made for statistical significance), the 
reguired procedure can be illustrated here 


Simply as is shown in Table 6. 


This table follows the simulation through 
five cycles (number of threats drops to zero 
five times). In only one cysle does the 
humber of threats in the system climb to 


three--criterion for mission failure. 


The resulting statistic for mission failure 


is: 


Expected % of mission failures = 


100 xX 1/5 = 20%. 
USED IN LITERATURE: 
a) Bittner, oer uboe Computerized Accomodated 
Percentage Evafuation: “HReviéw and Prospectus. 
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TABLE 6 
SAHPLE SIMULATION RUNS: FIVE CYCLES 


eee | 
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Arrival Service Next 
tine time service Number 
Random incre- Next Incre- comple- Event OL 
humber ment arrival ment tion time Lareats! 
Cycle 1 
‘a 24 24 anal See 0 Q 
ZO 10 34 13 37 24 1 
NM 14 48 34 2 eal 
6 13 50 30 1 
4 14 Se 48 2 
1 5 5 50 1 | 
Cycle 2 
5a 23 Q 
Ag 8 70 3 65 62 1 
Cycle 3 
{az 65 0 
Bre 12 a2 ies ao 70 1 
{ 8 90 82 2 
4 9 98 59 1 | 
1 8 Sus 90 2 | 
gD 8 106 11 109 a3 Z 
é 18 124 106 3; 
2 5 114 109 a | 
1 3 117 114 1 | 
Cycle 4 
5aE 117 0 
eee : 16 140 13 lee 124 1 | 
cle 
es - 137 0 
oes 24 164 7 147 140 1 | 
ee @ 1 47 0 | 
a | 
a J 
Pacific Missile Test Center Pt. eels Che 
December 1976. (PMTC-TP-76-46, AD-A035 205f.- 
About a dozen research. efforts are reviewed 
which employ Monte Carlo simulation for computer- 
ized accomodated percentage evaluation (CAPE). 
These models are used to determine what proportion 
of the population will be able to use a_ given 
system, based on anthropometry. 
b) SOnReY's M.C., and Wareerans, = one. "CAPABLE. same 
Computer Program to Lay Out Controls and Panels", 
Ergonomics OF Noy 297-3 on 


A Computer 
Arrangement by Logical 


described, 


a7 
program called 


Controls and Panel 
Evaluation (CAPABLE) 1s 


and results of its use are discussed. 
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C) 


d) 


e) 


f) 


g) 


h) 


Hudson, Bete "Adaptive Technigues on 
Multiparameter Problems", Human Factors, Vol. 11, 
NO. 6, LoD. eo |l—-s09S) 

A Simulation technigue is used for conductin 
multiparameter experiments so that the number o 
data points investigated 1S a minimum. The method 
is baSed on observations that human responses to 
psychophysiological inputs are lawful rather than 
random, and so can be predicted from mathematical 
Palak Tene « Data collected from a_ few. points in 
the experimental matrix are fitted with a low- 
order polynomial, using a computer program to 
evaluate the coefficients. Various values 
predicted from this equation are compared with 
Other data values, and improvments are made in the 
fit as needed. 


McDaniel J.W. Computerized Bion ca 
Man-Model. Aerospace Medical Research Lab 
eae Soe R Oe Bie OH; Jul 
{AMRL-TR-78-30, AD-AO0N32 402). . 

COMBIMAN is a computerized interactive graphics 
technigue for workplace design. |. The simulation 
allows manipulation of a three-dimensional male 
form of variable anthropometry, and the designing 
of a workspace around him, using a lightpen. 


Meldrum, W.G. A Digital Simulation with Human 
Interaction of One vs. Many Air-to-Air Intercept. 
Maste 1180600 Postgraduate School, March 


EVs 
1973 (NPS T 154 ' 

_ A. single- vs. multiple-aircraft intercept 
MiSSion is modeled peeean Cgeeed Yes mulation , 
incorporating SO ag graphics and HU RGUESS human 
Pheceace lon. NO 2 So mbeoodsal2 ty = or Kitl at each 
position of possible weapon release. 


Pacis, D.-Lle, andpSpringerg wW.E. "Human Factors 


' Engineering Analytic Process Definition and 


Criterion Development for Garr rr ou Ergonomics 
Aemuaemoe VOle 1U',” NOs lye 1978, pe by. 

The Computer Aided FUnctron=Allocatioa 
Evaluation Systen sone.) 1s evaluated for ability 
to support uman factors engineering 1n systems 
development. 


P Martin, and Brewer, G.D. Models, 
tions and Games--a ee ~kand 
ee oe Maye 1972 (R=TUGO—-ARPAZEC, NPS JU 


Approximately 450 active military models, sinu- 
lations, and games were identified, from which 132 
were chosen for study. Four CN oe were identifed: 
gee models, machine simulation, man-machine 


Simulation, and free-form gam hi - Purpose, 
usefulness, and expense of each model was anal- 
ysed. An inverse relationship between size and 


usefulness was observed. 





SlScciyat.,madeWolf, J.J. Digital Behavioral 
Simulation: State-of-the-Art and Implications. 
Applied Psychological Services, Inc., ayne, PA, 
June 1981 TAD-A1 O-64 1) -2 
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We 


1) 


3) 


a) 


b) 


C) 


A review, analysis, and appraisal, along with 
resentation of examples’ 0o current models. 
roblems in model design cost-benefit tradeoffs, 

and future trends in ehavioral modeling also are 
discussed, along with recommendations for develop- 
ment and Maintenance of current Army nodels. 


Streib, ete, and Wherry, aa are JI. An 
Introduction to |. Human Operator Sinuw lagers 
eta “~Inc., Willow Grove, PA, Decenbéer T979 
(TR-1400.62-D, AD-A097 520). 

HOS is a digital computer program used in eval- 
uation of performance in complex crewstations. The 
activities of an operator perception, physical 
movement decision making, etc. are sSinulated 
dynamicaily. The system predicts how long each 
activity will take. 

See also The Human Operator Simulator, Vol. 9 
HOS Study Guide, by U.I. Strieb, F.A. Glenn, an d 
Bees pont aes wor. (September 1978, TR-1320-Vo1l-9, 


WOE CMan je Deser, and others. §## The SAINT User's 
Manual. Pritsker and Associates Inc., West 
Tatayétte, IN, June 1978. (AD-A058 724) . 

SAINT (systems Analysis of Integrated Networks 
of Tasks) is a. network modelin and simulation 
technigue used in design and analysis of complex 
Man-maChine systems. Systems can consist of 


discrete tasks, continuous state variables, and 
interactions between then. 

See . also Simulation Using SAINT: A 
User-Oriented Instruction Manual, by the same 
authors (July 19783, AD-A058 87T). 
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Daellenbach H.Ge and others. Introduction to 
Operations Research Technigues second Edition. 
Boston: Allyn & Bacon, iInc., TI636 

Good introduction to the subject. Excellent 
examples of flow diagrams, and of setting up data 
for Simulation runs. Good discussion of sinmula- 
tion programming languages. 


Hillier, F.S., and Lieberian 7s Gc. Introduction 

to Operations keseacch. San Francisco: 

Holden=Da y 7aemicer, : ; ; 
Good examples. Good discussion of variance 


reducing technhigues (Monte Carlo techniques). 


Wagner, H.M. Principles of Operations Research. 
New Jersey: Prentice-Hall, Inc., : | 

_ Excellent, clear introduction to the subject, 
with emphasis on the procedures used in building a 
Simulation model. 


VII. MODELS FOR OPTIMIZING 


The technigues covered here are representative of those 
used to obtain the best possible solution to a problem when 
a number of constraints also must be met. These constraints 
may be laid on us by physical laws (we cannot exceed the 
speed of Jake lais - for example), man-made laws 
(55-mile-per-hour speed limits), or simple economics’ (we 
have only so much money to spend on gasoline). 

In this section, we will consider linear programming, 
Nonlinear programming, network analysis, and distribution 
models. These four operations research models (and corre- 
sponding techniques) are used to find satisfactory solutions 
to problems involving the allocation, use, or distribution 
of scarce resources. The scarce resources usuaily are 
money, time, equipment, or people--all available in less- 
than-infinite quantities. The optimum solution for such a 
problem may be one that maximizes some neasure of benefit or 
utility (such as profit or survivability), or minimizes some 
measure of cost [Ref. 42]. 

Linear programming, the first of these four techniques, 
is a geometric or algebraic procedure for optimum allocation 
of some resource between two or more alternatives, in light 
of certain goals and in light of certain constraints or 
conditions [Ref. 43]. Emphasis is on optimum allocation or 
mix, and on linear (straight line) relationships among vari- 
ables. The tern "programming" does not refer to computer 
programming (although that usually is involvei, for real- 
life problems); rather, it is a synonym for "planning"'-- for 
an orderly, step-wise approach to a problen. 

Nonlinear programming also is used for obtaining an 


optimum allocation of resources, but does not require that 


relationships be linear. Only rarely can graphical or alge- 
braic procedures be used "by hand" to solve real-life prob- 
lems which have nonlinear constraints. Computer software 
packages are widely used for this purpose. 

Network flow models are useful for determining the best 
path along which to transport resources, in order to meet 
needs for these at various locations or times. In addition 
to their use for transportation of physical goods, network 
analysis technigues are used for project planning and 
control--the flow of a project through the steps needed for 
its completion. Two well-known network technigues for the 
latter problem are the Program Evaluation and Review 
Technigue (PERT), and the Critical Path Method (CPM). 

Finally, distribution models are used when a commodity 
is available at a number of sources andis needed at a 
number of destinations. The goal is to identify the least- 
cost transportation plan, from sources to destinations, 
while meeting the requirements of the users at the destina- 
tions and remaining within the amounts of the commodity 
available for distribution. 


A. LINEAR PROGRAMMING MODELS 


1. PURPOSE OF MODEL/TECHNIQUE: Determining the best way 
to allocate scarce resources among the demands of 


competing activities so that either tne level of 


service (productivity) is maximized or the cost is 
minimizei--while operating within a set of 
constraints. 


a) Algebra, simple, linear 
b) Descriptive statistics 
c) Graphs and plots 

d) Computer prcgramming 


e) Computer packages 


HUMAN FACTORS APPLICATIONS: 


a) 


a) 


Designing systems, where relationships among 
system variables can be described in terms ofa 
set of linear equations, and an optimum allocation 


of a scarce resource is needed. 


Model: A system or process is described as a 

function of seven things: 

1) A set of decision variables (factors over 
which the allocator has control) that repre- 
sent the amounts of each scarce fresource 
(people, dollars, weapons) to be allocated 


among those who want then. 


gay An objective function or mathematical state- 
ment which relates the decision variables to 
each other via a linear equation; -for 


example: 
aqx 1) bD(xZ)y = Z, 


representing the proportions, a and Dy e2Or 
dollars, x, going to activities 1 and 2, to 
yield a total of 2z dollars. This unctaion 
May be minimized (e.g., total costs, Zz, be 
as small as possible) or maximized (e€.g., 
productivity, Ze be as great as 
possible)--depending on whether the decision 


variable represents costs or benefits. 


iii) A set of maxinum-setting constraints (supply 
constraints), which say that various deci- 
Sion variables cannot exceed certain values 


(that the amounts acre limited--by law, 


iv) 


Vv) 


vi) 


vii) 


physics, economics, the nature of measure- 
ments, etc.). These must be expressed as 


linear equations or as linear inequalities. 


A set of minimum=setting constraints (demand 
constraints), which say that at least a 
certain amount of some decision variables 
must be available--again expressed as linear 
equations or ineyualities. This includes 
non-negativity constraints, which say that 
the amount of each decision variable must be 


greater-than-or-equal-to zero. 


At least one feasible solution which sinul- 
taneously satisfies all constraints. Jhse 
there are more than one, the set of feasible 


solutions is called a feasible region. 


At least one optimal solution, which isa 
feasible solution that yields the most 
favorable value for the objective function 
{sometimes there will be an infinite number 
of these, if the line representing the 
objective function happens to be parallel to 
the constraint line that 1s setting the 
iimits). 


A stopping rule (needed for the algetraic 
simplex method) which specifies away to 
recognize an optimal solution and to discon- 
tinue the iterations that have been seeking 


that optinun. 


Assumptions: 


1) 


Divi Slbiliaye All variables can assume any 


real value--fractional or integer (integer 
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ii) 


111) 


linear programming is a subcategory which 
does not require this assumption; see 
Daellenbach and others, p. 519; Hiilier and 
Lieberman, p. 714; Wagner, p. 469). 


Non-negativity. All variables are non- 
negative (exist in quantities greater-than- 
or-equal-to zero). If it should happen that 
an activity can occur at negative as well as 
positive levels (e.g., we have the option of 
either buying or selling one of the items we 
consider to be decision variables), two 
separate decision variables are introduced: 
x+ for non-negative levels and x- for non- 


positive levels. Their difference, 
x = (xt) - (x-) 
represents the actual level of the activity. 


Linearity. All relationships among vari- 
ables are linear or can be represented 
linearly through transformations. Thats, 
the contribution of each variable is 
over the entire range of values that vari- 
able can assume. Also, the contributions of 
the variables are additive: the total 
eguals the sum of the individual contribu- 
tions, regardless of the values of the vari- 
Peres. (aC. weet ere abeeno interactions). 
Even if this assumption is not met exactly, 
linear programming remainS a convenient and 
powerfui approximation, if relationships are 
close to linear within the range of solution 
values [ Ref. 44}. 


121 


iv) 


Me) 


Known constants. All parameters of the 
model are known constants. That is, the 
relationships expressed in the describing 
egGuations (the coefficients of the decision 
variables in the objective function and in 
the constraints) have already been deter- 
mined. This assumption also is violated at 
times, since linear programming models are 


used to select some future course of action. 





This requires that the parameters be based 
on predictions of future conditions-— 


introducing some uncertainty. 


Convexity. The set of constraints must forn 
a feasible region which is a convex polyhe- 
dion. ThiS guarantees that any locally 
maximum solution is also globally maxinun, 
and that no two constraints are mutually 


exclusive. 


c) strengths: 


1) 


ah) 


Commercial computer programs are available 
that are capable of solving huge problems 
With thousands of variables and constraints, 
uSing variations of the simplex method. 
This is possible since the number of itera- 
tions needed to find a solution increases 
only linearly with the number of 
constraints. 


Smaller problems (two or three variables and 
a half-dozen constraints) can be solved 
graphically (as is illustrated below). Axes 
on the graph represent the decision 
Variables, andthe contraintS are shown as 


lines setting bounds for these variables. 


W222 


d) Weaknesses: 


e) 


1) 


a5 L)) 


ies) 


It is necessary to set up both the objective 
function and all constraints as linear equa- 
tions or inequalities. Thus relationships 
among the variables must be expressable in 
the same general terms and be approximately 


linear. 


Even with the use of efficient computer 
programs, solving large systems of equations 
Simultaneously is time-consuming and 


expensive. 


While the algebraic simplex method can be 
used "by hand" for problems of up to half-a- 
dozen variables and constraints, computa- 


tions are arduous and prone to error. 


General Procedures: 


1) 


aaiy) 


Define clearly the resources that are to be 
allocated (the decision variables); deter- 


Mine what units these will be expressed in 


(dollars, man-months, kilograms, years, 
niles, etc.--as 15 appropriate to the 
problem). Assign a different symbol to 


represent each decision variable (x1, x2, 
Mop ectes ee fOr dolldrs going to activity 1, 
Give eee clGtiVvVity 3, @tc.). Determine 


whether maximizing or minimizing will be 


done. 
Determine the mathematical relationships 
among the decision variables, and express 


these in the form of a linear equation 


(objective function). Linear regression may 
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asd.) 


be useful for setting up this equation, if 
empirical data are available but the linear 
relationships among them are not obvious. 
The resulting equation should be of the 


form 
{a1} (27) + (Capea) + 23S = Z, (7om 
where atl and a2 are the coefficients 


relating the variables, x1 and x2, and gz is 
the total value to be maximized or 
minimized. 

Enumerate the constraints which must be met. 
Formulate these into linear equations or 
inequalities, using the same symbols and 
units for decision variables as appear in 
the objective function. These constraints 
usually will be in the form of inequalities, 
such that the sum of some of the variables 
cannot be greater than some specific number 
(or less than a given value, in other 


cases). 


Procedures for a Graphical Solution. (no more 


than three decision variables; two preferred; see 


example below). 


1) 


ji) 


Label the coordinate axes of a standard 
Carteseanhn coordinate system to represent the 


decision variables. 


Plot all constraints ~~ (inclu ding non- 
negativity constraints) onto these axes to 


define the feasible region. 
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1ii) Lay out the objective function aS a series 
of contour lines which represent the 
constant slope of that equation, at several 
values of Z, as it intersects the axes at 


various values of the decision variables 


iv) For a maximizing problen, that point 
farthest to the "northeast" where a contour 
lies within the feasible region represents 
the best (biggest) possible combination of 
decision variables, and the optimum solution 


for the objective function within the 


constraints. 
v) FOr a Minimizing problem, the optimum point 
will be found in the "southwest" corner of 


the feasible region, in that non-negative 


quadrant. 


Procedures for an Algebraic Solution (using a 


Computer software package; see references below, 


for details of how these computations are done). 


i) Convert all inequalities to equations by 
introducing slack (for <¢ inegualties) Or 
surplus (for 2 inegualities) variables. 


These represent the amount by which the sun 
of the decision variables could be increased 
(slack) or decreased (surplus) and still lie 
within the feasible region. For example, if 


aeoneceragmtosays that 


mia 6 + 2{x2) Ss 90, (7 oy 


12 


we can introduce a new variable, (s1), and 


say that 
Si(sijast 2(x2) + (si) =eaae (i s33 
ean) Represent the entire linear programming 


problem in the form of a table, in detached 
coefficient form (see example below). 
Variables are laid out across the top of the 
table to form columns (X77 xZe x3, Si 
etc.) s The far right-hand column contains 
the right-hand side of each constraint egua- 
[eel ONG Each row represents one of the 
constraints. The coefficients for each 
variable in each constraint then form the 
body of the table (or matrix). For conven- 
lence in entering data, the objective func- 
tion also is laid out in this form, either 


at the top or the bottom of the constraint 


Rat r 1x. 
111) Follow the instructions that came with the 
computer package, for data entry and for 


running the program. 


iv) The computer program will provide an optinum 
solution for the problem (or say why it 
cannot do so), yielding the recommended 
amounts of each scarce resource to be allo- 


cated to each activity. 


5. ACM EXAMPLE (Hypotheticai) 


i) A one-on-one engagement is planned between a 


fighter anda simulated adversary, in a 
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Ais) 


iii) 


iv) 


v) 


practice dogfight. The fighter is testing 
the concept of carrying two types of pod- 
mounted guns, each using a different 
ammunition. The pilot's performance in 
being able to switch between the two, as 
needed, will be measured. 


One type of ammunition (UR) uses spent- 
uranium rounds. It weighs 250 lb per 1000 
rounds, compared with 200 1b per 1000 rounds 
for standard rounds (SR). Prem aLtECrak tu can 
carry a maximum of 1500 1b of ammunition. 


Since this is a practice engagement, it is 
necessary to keep the cost of ammunition 
below $20,000, while enabling the fighter to 
be as "lethal" as possible in the dogfight. 
The UR ammunition costs more than the SR 
($7000 per 1000 rounds, versus $4000) --but 
is considered twice as lethal (a fact to 
use, if we wish to maximize "lethality' 


value). 


The gun using the UR ammo is less efficient, 
firing rounds at arate of 75 rounds-per- 
second (13 sec per 1000 rounds), to the Sk 
gun's rate of 100 rounds-per-second (10 sec 
for 1000 rounds). For this engagement, a 
total of at least 30 sec of jun employment 


time is desired. 


In order to ensure a fair test, at least 
1000 rounds of each of UR and SR_ must be 


carried. 
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i) 


id ) 


2) 


Decision variables are UR and Shy repre- 
senting the amounts of the two kinds of 
ammunition to be carried on one engagement, 
in 1000-round units. 


The objective function, to be maximized, is 
the lethality of fighter performance. Since 
UR contributes twice as much as SR to 
lethality, the equation is 


2UR + SR = z. (7.4) ° 


Our goal is to find the values of UR and SR 
which will yield the maximum value for Z, 
while meeting the constraints below. 


Our constraints, placed in inequality forn, 


are costs: 
TUR + SSR < 20 (ames1000 units), (7ae5 
weight: 


OS 250k + O- 25a. S ieee (in 1000-15 
units) , (7.6) 


time: 

TSUR + 10S Ree a0 (ln seconds), (7.7) 
quantities: 

UR = 1 4=(in 1000-round units), (7.8) 
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SR 2 1 (in 1000-round units) (7.9) 
(note that this also satisfies non- 
negativity requirements). 


1v) This same constraint information can be 


represented in tabular forn: 


Per 1000 Rounds UR SR Total 
$1000 cost 7 4 <20 
1000 1b weight 0.25 0.20 Sale 5 
Firing time, Sé€c 13 10 230 
Quantities, 1900s 1 1 2 
c) Graphical Solution. Figure 7.1 illustrates how 


the constraints are mapped onto a two-dimensional 
representation of the decision variables, UR and 
SR (the axes) and the objective function, Z 
(dashed lines). The point where the largest 
possible z-contour still lies within the feasible 
region (cross-hatched) is at (2.2, 1), and repre- 
sents the optimum values for UR and SR, respec- 
envied’ for this linear programming problen. 
"Lethality value" of 5.4 is the largest we can 
get, within the constraints. Note that the weight 
constraint is not a determining factor in the 
solution--maximum weight allowance is generous 
enough that it does not limit the amounts of the 


decision variables, in this instance, and the line 


V2 





Quantity 


Quantity 





3 
> 


ie 
| 








Figure 7.1 Graphical Solution to ACM Ammunition Problen 


representing it does not help define the feasible 
region. 

d) Checking the Graphical Solution. Substituting the 
values of 2.2 for UR and 1 for SR in each of the 


constraints, we can show that these are indeed 
met: 


Ta 


(2) (2.2) + (1) (1) 


(7) (2.2) + (4) (1) 


5.4 “lethality units" 


19.4 < $20K 


(0-2 meme fO22) (1) = 0.75060 tSex 1b 


(13) (2.2) 


(2.2) ent 


+ (10)(1) = 38.6 2 30 sec 


(tH 2 1 1000 rounis 


i) Introduce slack and surplus variables: 
7JUR + 4SR + si = 20 
OZ ou ret+aD. 25K + s2 = 1.5 
13UR + 10 SR as = 30 
UR - s4 = 1 
SR =. SSoe= 4 
ii) Prepare a detached coefficient table: 
Constraints UR SR sit s2 s3 s4 $5 
costs 7 u, 1 0 0 0 
weight 2p 42 0 1 0 0 0 
tine ges: 10 0 0 = 0 0 
gGuantity 1 0) 0 0 = 0 
quantity 0 1 0 0 0 al 
Soyect..£unct. 2 1 0 0 0 0 0 
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iii) Enter the above data values into whatever 
linear programming software package you have 
available on your conputer, and follow 


instructions for obtaining a solution. 


USED IN LITERATURE: 


a) 


b) 


Cc) 


d) 


UDF ecdee, OUTS MeM., and Walvekar, A.G. Bl}: 
mechanical Mode{f for fhe Upper extremity Using 
imization lea ate Humah Factors, Vol. iG 
e 5. 1974, Ppp. 58 —-594, F ; 

. Three anon eles are used for solving an opti- 
zation model for arm articulation joints: linear 
nd geometric programming, dynamic programming, 
nd Simulation. 


BY 
i 
Pp 
O 
1 


Benjamin, R. "Resources fepeomece Ergonomics, 
Vol. 15, No. 2, 1972,.@pepee--Zc5. 

A basic opt ii? gaveoe technigue is used to allo- 
cate skilled workers accenet ag to job require= 
ments. The technigue should e 
scale problems. 


useful for small 


Bland, R.G. "The Allocation of Resources Dy 
Linear peo oTaaianG | scientific American, Vol. 
244, No. 6, June 1981, Dp. TZo-1a4. 

e Simplex netho 1S discussed in terms ofa 

f pl thod d dint f 

"nolytope" (three-dimenusional solid). Several 
assignment problems are considered in depth. An 
excellent tutorial. 


Freund L.'s, eeee ana SaGOaky,u) 6. Ls "Linear 
eee see NE NG ee oe To Optimization of Instrument 
Panel and Workplace ee ", Human Factors, Vom 
9, Now 4, Is6d; a eoome. 

Small linear prograpaens peopeets are solved oi 
hand via the Hungarian method (see Daellenbach an 
others, Pp. ) and product _ method (described). 
The simplex nethod is used with a. computer 
peed cape for a slightly larger problem in instru- 


ment layout. 
Reid, R.A., and Sheets, £.E. "Applying Linea 
Programming to Logistics Phannangs, Defense 


Management Journal, Vol. 20, No. 2, 1984, pp. 

Use of "canned " linear programming packages 
for desktop microcomputers is deScribed in detail. 
A fine tutorial. 


ERENCES AND TEX@S: 

Bazaraa, Mose, and Jarvis, Jade Linear 

Programming and Network Flows. New York: Joan 

Wiley and Sons, 1972. 
Highly technical; requires much comfort with 

mathematics to follow. 


Ter 


b) Daellenbach E.G and others. Introduction to 
Operations Research Technigues Second Edition. 
oston: Allyn & Bacon nCc., 1983. 
An excellent introductory text, for both linear 
and nonlinear programming; easy to read. 


c) Hillier, F.S., and Lieberman, G.L. Introduction 
Operations Research. San —=Erancisco: 


to 
Holden- ay Aon. r) 1980. : L 

A readable explanation, for both linear and 
nonlinear models. 


d) Nagel, S.S., and Neef, Marian. Operations 
Research Technigues. . Beverly Halle Sage 
Publications, T1976. , 

Provides a very clear, brief example of how 


linear programing Can be used. 


e) Wagner, H.4M. Principles of Operations Research. 
New Jersey: Prentice-Hall, Inc., T975. 
A large number of examples are provided-- 
clever, but not always easy to follow. Both 
linear and nonlinear caSes are included. 


B. WONLINEAR PROGRAMMING MODELS 


1. 


PURPOSE OF MODEL/TECHNIQUE: Determining the best way 
to allocate scarce resources among the demands of 


competing activities so that either the level of 


service (productivity) 1S maximized or the cost is 
mininized--while operating within a set of 
constraints. 


There 1S no “universal" NLP alogrithm or technique. 
Algorithms are tailored to specific program classes. 
Computer software packages vary widely, both in 
applications and in requirements for use. Thus is it 
quite difficult to generalize about this technigue. 
Potential users are advised to determine whether a 
nonlinear programming package is available to then; 
ir WSo,; they should study documentation on that 


particular software package. 
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MATHEMATICAL TOOLS REQUIRED OR USEFUL: 


a) 
b) 
Cc) 
d) 
e) 
r) 
9) 


a) 


Algebra, simple, linear 

Calculus, single variable, multiple variable 

Logic and set theory 

Descriptive statistics 

Graphs and flots 

Computer programming 

Computer packages 

Designing systems, where relationships among 
system variables can be described mathematically 
in a form acceptable to whatever nonlinear 
programing computer package is available, and an 
optimum allocation of a scarce resource is needed. 


USED IN LITERATURE: 

a) Faerber, Kk. a... sun. Optimal Multimojiel Parameter 
Identification in the State Space” MNodef or the 
Human Operatoc. Air Force Institute Or 
Ao Ee ne Wright-Patterson AFB, OH, December 
1974 (GE/E277 9-82 , RANG 07 
_. Bounded random search techniques are used to 
identify parameters of interest, which are input 


b) 


b) 


into a clustering algorithm which identifies the 
human's Tae SSeNy j-dimensional hypersurface. 
Newton-Raphson or gradient search techniques then 
are used to determine local and global maxima for 


the performance parameters. 


KO Wl) ee GlasS eames] Co, and Vikmanis, 4.fW. 
Reduced O Qbserver Model for Antiaircraft 
Artillery (AAA) tracker Response. Systems 
Research Labs, ine? Dawton yp wmode August 1979 
(SRL-6872-7, AD-A080 932) - 

Luenberger reduced-order observer theory, least 
squares curve fitting, and the Gauss-Newton 
Gea ene algorithm are used in an iterative simu- 

ation of human tracking error. 


Ha 
Qu 
D 
2 


ERENCES AND TEXTS: 

Daellenbach el lew. and others. Introduction see 
Operations fesearch Techniques Second  Editzrone 
OStOn: Sillyi  Bacongeuic., 63. 

An excelfent introductory text; easy to read. 
Hillier, F.S., and Lieberman, G.L. Introduction 
to Operations Reseacch. San Francisco: 
Holden-Day7 ine. , so o0. 


A readable explanation. 
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c) Nagel, Dom and Neef, Marian. Operations 


Research Techniques. Beverl Hills: Sage 
banbicawions, 197. . ; 
Provides a very clear brief example of how 


nonlinear programing can be used. 


d) Wagner, “H. H. Principles of Operations Research. 
New Jersey: Prentice-Hall, Inc., T1975. 
A ieee number of examples are provided-- 
u 


clever, not always easy to follow. 


C. NETWORK MODELS 


7 


PURPOSE OF MODEL/TECHNIQUE: Determining the best 
possible path through a series of events or loca- 
tions, in order to maximize flow (or minimize cost or 
time) between the start of a process (or a source of 


goods) and a specified endpoint. 


a) Logic and set theory 

b) Probability theory (for PERT) 
c) Descriptive statistics 

d) Graphs and flots 

e) Computer programming 


f) Computer packages 


a) Describing systems, where one or more faths 


through a system of events can be determined. 


b) Designing systems, so that the best possible path 


is determined. 


a) Models: A network system or process is described 
as @etwmiction of eight things 


15 


i) 


ii) 


31:33) 


iv) 


Vv) 


v1) 


eats) 


Nodes (vertices); points in time or space 
which represent events, tasks, or locations 
(usually shown as circles on a network 
graph). 

Links (lines, arcs, edges, or branches): 


connections between any two nodes, associ- 


ated with a flow from one to the next. 


Direction of the flow, as it moves between 
nodes (Shown by an arrow head). All links 
can have a flow in either direction 


(although flow capacity may have a value of 
zero in one direction); net flow is the 


difference between the two opposing flows. 


Capacity (distance, cost) of the flow along 
a link between two nodes; a numerical value 
which is used in MaxXbmizing or minimizing) 
the guantity of interest, over the entire 
network, by choosing the best links. A flow 
direction that is not permitted is givena 
Capacity limit of zero. Positive excess 
Capacity is whatever capacity is unused, in 


a given link. 


SOUbGCe. a node which has all those links 
that are connected to it directed away from 
a tee 

Sink: a node which has all those links that 


are ccnnected to it directed toward it. 


Pa thie a set of connected links such that 
any node is passed through at most once. 
Excess capacity of the path is the mininun 


of. the excess capacities of all =tinakowem 
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b) 


viil) 





teat Pati. A feasible path is a path that 


* - 


has positive excess capacity, aS it goes 


from the source to a given node. 


Tree: A network having one more node than 
links; i.e., the path through the network is 


unique for each pair of nodes. 


Assumptions: 

i) Divisibility. Flow capacity can assume any 
real value--fractional or integer. This 
assumption often is violated in the case of 
discrete units, if they are sufficiently 
numerous to be "essentially" continuous. 

il) Conservation of flow. No flow is lost 


iar) 


iv) 


v) 


Vi) 


vil) 


within the network. 


Optimality. The solution is optimal if 
there 1s no path from source to sink which 


has positive excess capacity in every link. 


Non-negativity. All variables exist in 


guantities greater-than-or-egual-to-zero. 


Linearity. All relationships among vari- 
ables are linear (contributions proportional 
to values, constant over the possible range 


of values, and additive). 


Knowh constants. All parameters of the 
model are known constants--have been empiri- 


cally determined in some manner. 
Homogeneity and equivalence. The product or 
commodity is homogeneous, regardless of its 


source or destination. All sources are 


equivalent (as are all destinations), except 


13 


EOE flow capacities along the Links. 
Otherwise, we do not care from which source 


any destination gets its product. 


c) Strengths: 


1) The procedure is simple to follow, appeals 
to logic, and is easy to defend. 


2.15} The algorithn is easy to program for 
computer use, as 1s illustrated in the 
references below (Daellenbach and others, 


Hillier and Lieberman). 


d) Weaknesses: 


1) Only problems with less than a dozen nodes 
and links can be done using the graphical 


method shown here. 


ii) The capacity values for the links are crit- 
ical, and must be known with fair accuracy 
and precision if a useful answer is to be 


obtained. 


Procedures: The process described here is known 
as the labeling technhigue. It is used to keep 
track of a feasible path (if one exists) from the 
source to each node, and to record excess capaci- 
ties of the feasible paths to each node [Ref. 45}. 
1) Identify nodes and links for the problem of 
interest, and assign capacity values, using 
a network graph to lay out the problem (as 
is illustrated in Figure 7.2, in the example 
below). It is convenient to identify nodes 


with alphabet letters. 


i ) Starting at the source, find any path fron 


source to sink that Can accommodate a 
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pezeok) 


iv) 


v) 


positive flow of material (or whatever the 
flow consists of). Only one path through 
the network should be kept track of at a 
time; it is not necessary to consider all 
feasible paths for each iteration. The 
Smallest capacity value of any link in that 
path will determine the total flow for that 
path. 


Write down the amount of the excess capacity 
that will be required for the total flow 
alomg that path, for the limk from the first 
hode to the second. Also write down the 


letter-designator of the previous node in 


the path (A, in this case). These are the 
dabeis for that second node (8B), and are 


noted next to it in vector form: (excess 
Capacity value, previous node letter). Do 
not label anode if the flow equals zero; 
even though a link exists there, no feasible 


path exists. 


Taking the nodes in alphabetic order 
(convention), continue labeling, taking in 
turn each node in that path, as_ above. 
Continue until the Sink is reached. At the 
sink, hote the maximum amount (m) that can 


be transported along this path. 


Suberact the value nm fron the excess 
capacity (in the source-to-sink direction) 
for each link along that path. Add m to the 
reverse-flow (sink-to-source) Capacity £oE 
each link. This process yields the "updated 


excess capacity" value for each link, once 


eS 


f) 


vi) 


vii) 


viii) 


Other 
enees 


1) 


is) 


111) 


that first path has been considered--the 
amount that still can be carried along that 
link, if another feasible path can be found. 


Return to the source, and choose another 
path to the sink. Using the updated excess 


Capacity values, repeat the above process, 


Add the amount of flow resulting from this 
new path to that obtained from following the 
first’ path. This is the updated total flow, 
mi, which is also subtracted from each 
link's capacity, to obtain a new “updated 


excess capacity" value. 


Continue this path-definition process, from 
source to sink, until all feasible paths 
nave been traced. At this point, an optinum 
solution for the mnaximal flow from source to 
Sink has been obtained. 


calculations that may be made: See refer- 
below, for details of these calculations. 
Determination of the shortest route through 


a network, from source to sink. 


Minimization of the total Jength of connec- 
tions among all nodes ("minimal spanning 
tree problem"), neejed (for example) for 
transporting goods which are used at a 
humber of locations along a network of 


roads. 


Project planning and control, for which 
events are scheduled along a timeline so 
that scheduled project completion date is 


met, at minimal cost. 
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b) 


EXAMPLE (Hypothetical) 


shat) 


iii) 


iv) 


A total of 25 fighter ailrcmatt aboard a 
Carrier must be moved to the catapult area 
and launched, for a combat air patrol (CAP) 


mission. 


There are three routes along which the 
fighters may be transported. One of these 
is a direct route from parking area to cata- 
pult, on the carrier deck. The other two 
routes involve moving aircraft from below 
deck, via elevators, to the deck. 


Based on accessibility and conditions of the 
aircraft in their present locations and on 
the personnel available to nove then, ten 
aircraft (maximum) can be moved to. one 
elevator area (node B) and seven to the 
other (node C) within the alloted time. 
Five aircraft may be transported between the 
two elevator loading areas, in either direc- 
tion (or both directions, if needed), within 
that timeframe. From elevator 8B, four 
aircraft .can be gotten to the catapult 
within the tine linits, and ten may be 


transported from elevator area C. 


The maximum quantity of aircraft possible 
must be gotten from storage to catapult, 


Within the time available. 


Procedures: 


Prepare a network graph, as is illustrated 
in Figure 7.2, to describe the problem and 


the initial information that is available. 
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Figure 7.2 


0) 


iii) 


iv) 


v) 


V1) 





Network Graph Illustration for ACH Example 


Taking first the direct route (A,D), label 
node Das (8,A). The total flow resulting 
fron path. (A, D)) 1Ssaee 


Subtract the value of 8 from the (A,D) link 
capacity value, leaving a remainder of 0. 
Add 8 to the reverse flow value (originally 
zero), yielding a value of 8. 


Returning to the source, A, trace out path 
(A,B,D).- The label for node Bis (4,A), and 


for node D, at this iteration, is (4,B). 


Flow resulting from this path has a value of 
4, which 1s added to the value of 8 from the 
first path traced, to get a current teem 
flow™oGr 122 


Retracing the path just followed, 4 is 


Subtracted from link .(8,D)'s Capacity, 
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vii) 


Vier ) 


TE) 


x ) 


leaving a flow capacity of 0 (and added in 
the (D,B) direction, to yield 4). For the 
(A,B) link,: subtracting 4 from 10 leaves an 
unused capacity of 6 for this link (anda 


reverse direction value of 4). 


At this point, either the path (A,B,C,D) or 
the path ({A,C,D) may be traced. FOL 
SIMpPeTCity, (A5Cy7D) will be used next. 
Labels at this iteration become (7,A) for 
node C and (7,C) for node D. Total flow is 
increased by 7, yielding a value of 19 at 


ths epomnt . 


The final path (A,B,C,D) now is traced. 
Labels for this iteration are (3,A) for node 
BD, eee) EOt nmede C, sand (3,C) for node D. 
It should be noted that the remaining excess 
flow capacity of 3 at link (C,D) has limited 


this entire path to a maximum of that value. 


The final total fiow value is 22, when 3 
aircraft are added from this final path 
iteration. Within the time constraints, 
this is the maximum number of aircraft which 


can be gotten to the catapult. 


The reverse-flow values which were calcu- 
lated during the problem-solving process 
were not needed, for this example. In other 
cases, however, it will be found that 
increased flow values will be obtained some- 
times by what at first appears to be 


backtracking". 
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USED IN “DERE R anes 


a) 


b) 


c) 


d) 


e) 


t) 


Callahan, L.G., Jr., and Lovell, James. Gr 
Degradation of Air fefense Capa nilat ies. “Georgi 
a 1tute of Technology, June TI8Z. (AD No. BO7 

ncludes a brief review of approaches’ to 
weapons systems modeling a review of network 
methodologies, and a model of a battalion-level 
air defense network. 


Fakan, J.C. Application of Modern Network pheory 
to Analysis or anned Systems, Nationa 
Aeronautics and ears Administration, October 
1970. (TN-D-6034, NPS U 135276). a 

Network theory is used for describing man's 
functional roles in a human subsysten. Human 
parameters include heart rate, aS a measure of 


work output. A FORTRAN program is provided which 
outputs time of expected task degradation, based 
Qn input of human performance characteristics, 
etc. 


Lewis, Leslie, and Copeland, Melinda. Human 
Performance Requirements in C3 Systems and their 
Implications in System Design. RW  Derense and 
phage as Caney Redondo Beach, CA, March 1983. (AD 


1 
oo 
@®'U 


0 : 
The user interface with C3I systems is modeled, 
defining cognitive pi ee Sea aS quantitative, 
testable units. Techniques include the use of 
networks to translate these processes into systen 
requirenents. 


Pew ReW., and others. CETL iC view 
Analysis of Performance  wodels Applicable to 
Man=MNachine System Evaluation. Bolt, enak, and 
Wewman, inc. ga SEIS HA, March (BBN No. 
3446, AFOSR-TR-77-0520, AD-A038 597). a 

Five network-based techniques for predicting 
human per Oza ee are surveye and evaluated as 
pabts O fe tis aon ae comprehensive report. These 
include the SAINT, PERT, and THERP models. 


Pulat, B.-M. A Computer Aided Workstation Assessor 
for Crew Operations--wWOSTAS. North Carolina State 
University, ay TISZeen Deno Ales 045): 

A network-based model which is art of the 


Multi-Man-Machine Work Area Design and Evaluation 
systen (MAWADES) . WOSTAS groups activities on 
tasks of a_crew so that all job stations havea 
faery i ee amount of work, in terms of time to 
perform tasks. 


Randolph, P.H-, and Ringeisen Ds "A Network 
pear as WD pees with GER Analysis", Journal “ae 
Hath ematical Psychology, Vol. 11, No. 1, TY7G, pp- 

Graphical Evaluation and Review Technique 
(GERT) is used to analyse the teaching and learning 
process, when that process is represented asa 
stochastic network. A topology equation for a 
Closed network is used to obtain parameters for 
the teaching-learning process. 


144 


g) 


h) 


Smillie, R.T., and Ayoub, M.A. Nj Gee@Pert or nance 
Aids: Evaluation of Design Alternatives Via 
Network Simulation", Ergonomics Vol. 23, No. 4, 
W530, sees 19 339%. 

Network simulation is used as an alternative to 
laboratory experimentation to evaluate different 
combinations of job performance aid formats, 
combined with the effects of stress. 


Wortnan, 20.5. and others. The SAINT User's 
Hanual - britsker and Associates, Inc., } West 
Lafayette, IN June 1978 {AD-A058 724) 

INT (syste ems Analysis of a ae Networks 
of Rens) ls a network modelin and Simulation 
technique used in design and analysis of complex 
man-machine systems... Systems can consist of 


discrete tasks, continuousS state variables, and 
interactions between then. 

See also SAW Behe Using SAINT: A 
User-Oriented Instruction Manual, by the same 
authors (July 1978, ID= A058 671). 


REFERENCES AND TEXTS: 


a) 


b) 


Cc) 


d) 


e) 





Bazaraa, ose and Jarvis, a 5 ie Linear 
Pro rammin and’ Network Flows. New York: Joan 
Wiley and Sons, 1972. 


fighly technical; requires much comfort with 
mathematics to follow. 


Bronson, Richard. Schaum's Outline, Theory an 
Problems of Operations Research. New York 
McGraw-Hill Book Company, 1982. 

A brief but clear discussion of the maximal- 


flow, minimum-span, and shortest route problems. 


¢e(Ou 


Daellenbach, H.G. and others. Introduction to 
Cee Berens Research Technigues Second Edition. 
Ston: Heoesdecomn (nC .; “7983. 


An excellent introductory text; easy to read; 
good sections on CPM and PERT technigues. 


Haslet Hem, F.S., and Lieberman, G.L. Introduction 
0 se Research. San Francisco: 
Heiden pone. we 1980. 

An Sent | readable explanation, with clear 
applications of the technique to four classes of 
EEoeEe lS: micluding CPi and PEeRTs 
Wagner, H.4M. peauceeres 9 of Operations Research. 

EMes 


New Yen eNe Prentice=- 
severa Spa eS are Eee over, DUESnO: 


always easy to Follow. 
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D. 


DISTRIBUTION NODELS 


1. 


PURPOSE OF MODEL/TECHNIQUE: 
distribution schedule for 
between a number of sources 


tions, to meet demands from 


Finding the least-cost 
transporting a commodity 
and a number of destina- 


current inventory. 


MATHEMATICAL TOOLS REQUIRED OR USEFUL: 
a) Matrix or linear algebra 

b) Logic and set theory 

c) Probability theory 

d) Descriptive statistics 

e) Graphs and plots 

£) Computer programming 

g) Computer packages 


UMAN FACTORS APPLICATIONS: 


a) Describing systems, where they can be considered 


as a set of starting places and end points, 


connected by paths. 


b) DeSigning systems, in order to find the most effi- 


cient path between points. 


DESCRIPTION: 


a) Model: A system or process is described as a 


function ©f fourycniage: 


1) Sources, each of which has available a given 
guantity of units of a specified, homoge- 
neous commodity or product. 

1i) Destinations, each of which requires a given 


quantity of units of that same commodity or 


product. 

111) Cost of tranSporting one unit of produce 
from one of these sources to one of these 
destinations. 
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b) 


iv) Variables, that is, the to-be-determined 
number of units to be shipped between | a 
given source and a given destination. Basic 
variables are variables which are assigned 
numerical (non-zero) values in the current 
solution. Nonbasic variables are "unas- 
Signed variables"; that is, they have a 
value of zero (no goods are shipped fron 
that source to that destination, for thas 
solution). 


1) Integral units. Treweprodguct occurs in 
integer units only; that is, a unit cannot 


be further broken down or fractionalized. 


11) Non-negativity. All variables exist in 


quantities greater-than-or-eqgual-to-zero. 


1ii) Linearity. Ail reiationships among  vari- 
ables are linear (contributions proportional 
to values, constant over the possible range 


of values, and additive). 


iv) Known constants. All parameters of the 
model are known constants-~have been empiri- 


cally determined in some manner. 


v) Conservation of flow. No product is lost 


within the transportation network. 


vi) Equal supply and demand. Total supply and 
totai demand are egual. If this 1s not true 
in actuality, either a fictitious source or 
a fictitious destination is created to 


provide or absorb the extra product. 
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vil) 


Homogeneity and equivalence. The product or 
commodity is homogeneous, regardless of its 
source or destination. All sources are 
equivalent (as are all destinations), except 
for cost of distribution. Otherwise, we do 
not care from which source any destination 


gets its product. 


c) Strengths: 


1) 


ii) 


1) 


ii) 


The procedure is simple to follow and 
appeals to logic, so is easy to defend. 


The algorithm is easy to program for 
computer use (see Daellenbach and others, 
pp. ter — 166). 


The procedure of optimization becomes 
arduous, if there are more than a handful of 
sources and destinations. In this case, the 


aid of a computer is mandatory. 


Degeneracy 1S a frequent occurance in the 
distribution problen. This results in the 
"stepping stone" algorithm going from itera- 
tion to iteration without any improvement in 
the distribution. See Daellenbach and 
others, p. 165, Ob errouson, iD. 12, £@ca 


treatment of this problen. 


e) Procedures: These procedures are illustrated 


below in the example. 


1) 


Set up a matrix or tableau (see Figure 7.3) 
showing complete data for the problen: 
sources and availability (supply) of prod- 


ucts (rows), destinations and reguirements 
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i1) 


hts) 


(demand) for products (columns), and distri- 
bution costs (noted .in the upper left corner 


in each cell). 


=X 


Find an initial solution, via the "Northwest 


Corner" rule. Beginning with the northwest 


(top left) corner cell in the tableau, allo- 
cate from the amount available at “Source 1 
aS Many units as possible to Destination 1 
(up to the total amount available or the 
total required). Write this number in the 
cell. Thereafter, continue by moving one 
cell to the right (if some product remains), 
allocating units of product to the next 
Destination. If no supply remains in Source 
1, move down the matrix one cell. Now the 
product from Source 2 will be allocated to 
the Destinations, untii it is all used up. 
The procedure is continued until the "south 
east" (lower right) corner of the matrix is 
reached. This yields an initial feasible 


solution. 


Teste tims sSOuutrOneLOr Optimality, which is 
a function of the cost of this particular 
solution for the given problem. ROwdGnsor, 
create testing variables, u (associated with 
the "supply" rows; see Figure 7.3), andv 
(associated with the "demand" columns). For 
each cell, the sum ({u + v) must egual the 
cost value, c, for that cell. Arbitrarily 
choose some u variable associated with one 
supply row, and set it equal to zero. No w 
we Can set up sufficient (u + Vv =c) equa- 


tions to solve for uandv for each column 
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1Vv) 


and row, starting with the basic variable 
celis. Note that some values of u and v may 
be negative at this point. Next, subtract 
both u and v from c, for each nonbaSic vari- 
able cell in the matrix, to find the value 
(c - u- v) for cells that presently have no 
allocation of product from that source to 
that destination. Place this number in the 
lower right-hand corner of this nonbasic 
variable cell. If at least one of these (c 
- u- v) values is negative, the current 
solution is not optimal. A better solution 
will be found by increasing the allocation 
(presently zero) in the cell having the most 
negative value for (c - u- vj). Place a "+" 
sign in that cell, to signifiy that increase 


is desired. 


Improve the solution. Identify a loop in 
the matrix, so that the loop contains the 
cell with the "+" and at least three other 
cells all of which contain values for basic 
variables. The sequence of cells in a loop 
must be such that each pair of consecutive 
cells lies either in the same row or the 
same column (no diagonals), but no three 
consecutive cells do. No cell can appear in 
a loop more than once, and the loop must be 
closed, with beginning and end lying in the 
same cell. Increase the allocation to the 
ie ace] LT as much as possible, while 
adjusting other cell allocations in the loop 
so that supply, demand, and nonnegativity 


constraints are not violated. This results 
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v) 


f) Other 
ences 


1) 


ii) 


ceeds) 


in a new solution to the distribution 
problem. Prepare a new tableau showing the 


solution (see Figure 7.4). 


Once again check for optimality, as in step 
(iets). If the solution still is not 
optimal, repeat step (iv). Continue this 
process until a solution is obtained for 
which no value of (c - u- v) is negative. 


This solution will be optimal. 


caiculations that may be made: see refer- 
below, for details of these calculations. 

Transshipment problems, with “warehouses" 
available to facilitate Shipments in two 
stages, rather than directly from source to 


destination. 


AsSignment problems, where a given number of 
candidates must be assigned uniguely to a 
specified number of jobs (one-to-one) in 
such a way that all jobs are completed in 
the Minimum total time. The Hungarian 
method is the most efficient technigue for 
this problem (see Daellenbach and others, p. 


WS, “or=Brenson, p25). 


Traveling salesman problems, where one indi- 
vidual must leave a base location and visit 
a humber of other locations, one time each, 
then return to the Starting location. 
Objective is to minimize the distance or 
cost of travel (See Bronson, pp. 85 


Daellenbach and others, p. 662). 


15m 


oe 


ACM EXAMPLE (Hypothetical) 


a) Situation: 


i) 


145) 


pet) 


A’ new cockpit is being designed for a 
two-man fighter aircraft. The crew station 
will contain several CRT-type displays, 
Capable of providing a wide variety of 
information to the crew from a number of 
sources. These displays will be placed so 
that each is available for monitoring by 
either crew member during a typical air-to- 
alr mission. However, it is critical that 
each display be monitored, and that neither 
crew member be overloaded with monitoring 
tasks, which also include radio communica- 
tions and visual out-the-window inspections 
of the area. 


Task analyses indicate that the pilot must 
spend 60% of his time in flight control 
tasks, leaving 40% for monitoring the infor- 
mation displays, etc. The radar officer 
(RO) will be busy with navigation and weapon 
delivery tasks 40% of the time, leaving 60% 


for monitoring-type tasks. 


Five sources of information must be noni- 
tored: a radar warning receiver display 
(QWR), a tactical information iisplay (Thom 
and the air-to-air radar scope (RDR), plus 
radio communications (COM) and frequent 
out-the window (OTW) checks of the surround-' 
ings. Table 7 shows the percent of time 
each must be monitored, based on analysis of 
the mission (totaling 90% of available 


time). Since it 1S desired to account for 
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100% of the crew's "spare" time, a "dummy" 


column is included for the remaining 10% of 


the time--perhaps representing time 


stretch, scratch, etc. 


TABLE 7 
PERCENT OF TIME INFORMATION SOURCES MUST BE MONITORED 


INFORMATION SOURCE 
RWR OTW TID COM RDR DUMMY 


MONITORING 
TIME, % 15 30 10 10 25 10 


EE 


to 
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iv) Monitoring each of these information sources 


is not equally easy for both crew members, 


due to locations, to interference 


With 


primary tasks, and to difficulty of inter- 


preting the information. MCosts OF Greeri- 


culty values have been assigned to these 


monitoring tasks, as is shown in Table 8. 


b) Procedures: 


1) Set up -an initial tableau for the problen, 
using all the information that has been 
provided. The tableau is shown in Figure 


no 
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TABLE 8 
RELATIVE DIFFICULTY OF MONITORING INFORMATION SOURCES 


INFORMATION SOURCES 
CREW MEMBER 


RWR OTH TID COM RDR DUMMY 
Pilot 5 2 9 1 9 0 
5 7 6 1 7 0 


Radar Officer 





| RWR OTW TD COM RDR Dummy cae pie | u | 


0 7 
60 0 


| Vv 9 ii 6 l 0 
_ ram 
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Figure 7.3 Initial ACM Distribution Tableau, First Solution 


119) The initial solution, shown in Figure 7.3, 
is found using the Northwest Corner rule. 
The pilot would spend 15% of his time moni- 
toring the RWR display and 25% looking out 
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led) 


iv) 


the window. The RO would spend 5%, 10%, 
10%, and 25%, . respectively, with the window 
monitoring, TID, radio communications, and 
radar display tasks, and 10% on the "dunny" 


task (unassigned time). 


This solution is tested for optimality by 
finding, first, the values of u and v, via 
solution of the equations, (u + v = c). For 
ease of computation, u2 is assigned the 
value of zero. Then, [rom the cost for cell 
(272), “2 1s found te be 7 (09 + vwA= 7, oF 
v2 = 7). Similarly, ¥3 = 6, vi = 1, ‘ttc. 
Now from the v2 value of 7 and the cell 
(1,2) cost of 3, we can detertline that ul 
must be -4 (ui +7 = 3, or ul = -4).Finally, 
we determine the value of v1 from (ul + vi = 
3) -4 + v1= 5, or v1 = 9.Now we examine 


the nonbasic variable cells to find the 


Values £or (€ ="u - Vv). For Com (1,3) 
meee = On =) )., aS is noted in the lower 
right-hand corner. For cell (1,4), (1 - 
(-4) = 5), etc. Continuing the process, we 


discover that the value for cell (2,1) is (5 


- 0 -9 = -4). Thus we find that this solu- 
fion #is not optsmads. This value of (-4) is 
the most negative (only negative, in this 


instance), so a "+" jis placed in cell (2,1). 


A-loop is now constructed (as 1S _ shown by 
the heavy lines in Figure 7.3), containing 
the cell with the "+" (cell (2,1)) =along 
with the three nearest cells with basic 
variables (adjacent cells, in this 


instance). The most by which cell (2,1) can 
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Pilot 


RO 


Figure 7.4 


v) 


be increased is 5, in order to remain within 
the "demand" constraints of 15 for the RWR. 
Thus, 5% of the RO's time will be taken away 
from monitoring OTW so that he can spend 5% 
of his time on the RWR display. The 


resulting new solution iS shown in Figure 
Tae 


TID COM RDR | Dummy Supplv u 


Ces rets te eee corres SANT ne eneeaeADOUNN eatiatnd COED 


Second Solution to ACM Distribution Problem 


The optimality of this solution now is 
tested, aS above. This time none of the (c 
- u- v) values is found to be negative (see 
Figu pee? =9)". The solution is optimal, with 
the pilot spending 10% of his time  noni- 
toring the RWR display and 30% looking out 
the window. The RO has no out-the-window 
tasks, but instead spreads his time over all 
the other displays and has 10% "free" time 


to do things not called out in the model. 
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Cc) Caveat: This example points up the importance of 
assumptions. For simplification, we have assumed 
here (assumption (vil)) that it makes little 
difference whether each of the tasks is perforned 
by the pilot or by the RO, as long as the assigned 
costs are considered. Thus, under the formulation 
here, the pilot ends up doing allthe out-the- 
window monitoring, and gets none of the "surplus" 
(dummy) time. Onder the Northwest Corner initial- 
ization process, a completely different allocation 
of tasks would result were the RO aSSignments 
listed in the first row of the matrix and the 
pilot assignments in the second. Whether the 
resulting allocation under this set-up would be 
equally good is debatable. 


USED IN LITERATURE: No examples of use of distribu- 








tion models were found in the human factors 

literature. 

REFERENCES AND TEXTS: 

Oesagatrad, U4.S., and Jarvis, Siete Linear 
Programming and Network Flows. New York: Jonn 
Witey and Sons, 19/72. 

Aeon y echnical; requires much comfort with 


Mathematics to follow. 


b) Bronson, Richard. Schaum's Qutline, Theory and 
Problems of Operations Research. New Ork: 
HeGraw-Hill Book Company, 1982. 

A brief but clear diScussion of the transporta- 
tion problem and degeneracy. 


GC) Yagemlenbach, H.G., and others. Introduction to 
Operations Research Technigues Second f&dition. 
Oston: Allyn & Bacon, Inc., Be. 
An excellent introductory text; easy to read. 


d) Hillier, F.S., and Lieberman, G.L. Introduction 
to Operations Research. San Francisco; 
Holden vavemanc., 950. 


LS 


e) 


_A good general explanation of the transpor- 
taion probiem and related algorithms. 


Wagner, H.M. Principies of Operations Research. 
New Jersey: Prentice-Hall, Inc. 
e 


Severa Gees are provided--clever, but not 
always easy to follow. 
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VIII. MODELS FOR DECISIONS 


A decision usually is considered to be a choice among 


alternatives. If there is only one solution or course of 
action worthy of consideration, there is no decision, as 
such, to be made. Instead, optimization techniques may be 
used to make the best of the Situation (as described in 
Chapter VII). Or descriptive models may be developed to 
describe the Situation better, and make predictions about 
the results of taking that course of action (see Chapter 
OI). 

The various alternatives may be discrete, separate enti- 
ties ("Shall I bire John Smith or Mary Jones?"); or they may 
be continuous functions (or nearly so) within a given range 
("dow certain should I be that an aircraft is unfriendly, on 
a target recognition continuum scale, before I shoot it 
down?")., 

One factor common to decision models is the need for at 
least one measure of effectiveness (MOE) and for some 
criterion or standard for making a choice. The decision 
model wili not provide these; they come from the decision 
maker himself, outside the modeling process. i” a0 hae 
needed if we are to measure the "acceptableness" of a given 
alternative. A criterion is required to tell us exactly how 


good an alternative must be, on that “acceptableness scale", 


in order to be "good enough" (in terms of money, time, 
pleasure, etc.). This concept 1s called "satisficing" (as 
opposed to the process of "optimizing", or finding the 


optimum solution). 

If no numerical MOES and cut-off criteria are available, 
it still will be possible to rank alternatives. However, 
subjective techniques then will be needed to choose the most 


value-effective possibility. 
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In the first section of this chapter we consider in 
detail the models and procedures used in what variously is 
described (with differing emphasis) as decision theory, game 
theory, or utility theory. Decision theory is the broadest 
of the three, and may be considered to include the others. 
Decision analysis is the basic technigue used with these 
decision theory models. 

Game theory emphasizes decisions where two or more indi- 
viduals are In Conmelrter over their opposing goals. 
According to Raiffa [{Ref. 46], classical game tneory 
attempts to offer advice to each of the conflicting individ- 
uals (a jointly prescriptive approach). More recent theo- 
retical studies have considered conflict situations from a 
one-sided prescriptive point of view, with the goal of 
helping one (and only one) party win. 

Utility theory emphasizes the expected usefulness or 
value of the various outcomes. Its major feature is devei- 
opment of a utility function (usually linear) that trans- 
forms payoffs (say in dollars) into a utility scale, based 
on some useful value of each payoff (perhaps whether that 
Many dollars will be enough to pay the rent). The resulting 
scale is then used in the decision analysis procedure. 

Signal detection theory models are briefly covered in 
the second section. These models already are used exten- 
Sively in human factors analyses, so are not discussed in 
great detail here. They can be valuable tools in evaluating 
the various outcomes of choosing different alternatives 
along a continuum of values. Interested persons may refer 


to the listed references for more details. 


A. DECISION THEORY MODELS AND DECISION AWALYSIS 


1. “BURPOSE OF *WODEL/ TECH Nmeur: Choosing one of several 


well-defined alternatives that will neet an 
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aspiration level, or predetermined criteria or stan- 


dards of adequacy. 


MATHEMATICAL TOOLS REQUIRED OR USEFUL: 





a) Algebra 

b) Boolean algebra 

c) Logic and set theory 
d) Fuzzy set theory 

e) Probability theory 

£) Descriptive statistics 


g) Graphs and flots 


=. = oe “el Ee Se ee Se eee eS SSE Se eS 


a) Describing systems, where a system includes alter- 
native outcome states, with varying probabilities 


of occurance. 


b) Designing systems, where a choice among alterna- 


tive systems or subsystems must be made. 


c) Evaluating human performance, when utility values 
can be assigned to various levels of performance, 


along with criteria for acceptable performance. 


DESCRIPTION: 

a) Model: A system or process 1s described as a 
Pinetion of 11 thangs: 
iW) A problem which requires that at least one 


decision (choice) be made. 


oa) A time horizon within which that decision is 
required. 
iii) The sequence of decisions which are 


required, in a multiple-stage problen. 


iv) A well-defined set of alternative actions 


(decision variables) from which a choice 
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v) 


Vi) 


Vii) 


Va 2s} 


ix) 


must be made, for solution of the problen. 
These are under the decision maker's 
Control. 


A set of events that possibly may occur 
(future states of nature, or chance points). 
if possible, these should be mutually exclu- 
Sive and collectively exhaustive. These are 


not under the control of the decision maker. 


The probabilities of occurance for these 


events. 


The set of payoffs or outcomes (outcome 





variables) which accompany these alternative 


actions and events. 


The Structural relationships between 
alternatives/fevents and their corresponding 
outcomes, expressed as a mathematical func- 
tion, if possible. The parameters of these 


relationships are included in this function. 


The utility values or "expected worth" of 





each of the outcomes. This may be the same 
as the outcomes themselves. If more than 
one factor is included in assessing the 
value or worth of a given outcome, these are 
considered nulti-attribute utilities. 
Associated with the utilities are measures 
of effectiveness (MOES), used to evaluate 
the outcomes. This may be as Simple as 
"more is better". If more than one MOE will 
be used, the importance of each should be 
weighted. Then the MOES may be aggregated 


into a single criterion function (usually a 
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b) 


linear combination), which can be used for 


evaluations. 


x) At least one criterion or aspiration level, 
which is used to determine that an alterna- 
tive and its associated outcome will result 


in a Satisfactory solution. 


xi) A payoff matrix and/or a decision tree. 
These lay out the above information in 
Lodarcal fom , so that the analysis can be 
performed. A payoff matrix usually is 
adequate sao) 0 a Single-stajge decision 
problen. A decision tree is required if a 
series of alternatives and events must be 


evaluated in order to reach a final outcome. 


3) Steady state conditions. The system is in 


eguilibrium; we are considering a problen 


that is not in a state of flux. 


I.) Relationship validity. The choices open to 
the decision maker may be adequately 
described in terms of payoff values or util- 
ities and their associated probabilities. 
The payoff matrix/decision tree used to 
describe the system iS an adequate represen- 
tation of the systean, for purposes of 


obtaining useful results. 


1ii) Certainty, risk, and uncertainty. It is 
possible to place the decision being made in 
one of the following categories: 
e under certainty: we assume that one given 
state will occur, and all others have zero 


Preoudot lity. 
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iv) 


Vv) 


vi) 


vii) 


e under risk: we can estimate the  prob- 
ability of occurrence for each possible 
future state, and two or more of these 
probabilities are positive. 

°* under uncertainty: we are unable to esti- 


mate the probabilities of various future 


states (although we can list those 
states). 
Known constants. All constant parameters 


and utilities used in the model are known 
values, obtained through some empirical data 
collection process (objective values) Or 
through logical deductions (subjective or 
Bayesian values). 


hown probabilities and probabilitiy distri- 
butions. Randomly distributed events can be 
characterized by known discrete of contin- 
uous probability distributions. These prob- 
abilities may be strictly objective, 
obtained through observations and measure- 
ments (the limit of long-term relative 
frequencies). They also may be subjective 
(Bayesian), based on a priori probabilities 


assigned by experts. 


Stationarity. Probabilities of events and 


outcomes do not change with time, within any 


one stage of a decision analysis process. 


independent alternatives and events. All 
alternatives and allevents are mutuaily 
exclusive. Thus, joint probabilities may be 


obtained by multiplying individual probabil- 


ities together. 
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vViil) 


1X) 


x) 


Logical consistency or coherence. Rational 
beliefs and actions all acre logically 
consistent with one another, involving no 
mutual contradictions. Note that coherence 
1s not sufficient to guarantee rationality, 


but it iS necessary. 


Ordering. It 1S possible for the decision 
maker to express preference or indifference 
between any pair of payoffs. That 1s, he 
can rank payoffs in order of value to hin, 
Or he can express no preference at all among 
them. 


Lie rity Of Wipltir-aeemmm@te utilities. “af 
several MOES are considered in developing a 
utility value, relationships among them nay 
be expressed as a linear combination 
{Contributions are proportional to values, 
constant over the possible range of values, 


and additive). 


¢) Streng ths: 


1) 


The technique of decision analysis is an 
excellent way to provide greater insight 
into a decision problen, and especially to 
open it up for discussion and conflict reso- 
HY eakto 9m It encourages scrutiny of the 
problem as a whole, and forces the decision 
maker to determine quantitative relation- 
Ships among the various parts of his 
problen. New sources for gathering and 
organizing information may be suggested by 
the process, and new alternative actions may 


be uncovered. 
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ii) 


iii) 


iv) 


The structures of payoff matrices and deci- 
Sion trees provide a convenient basis for 


communicating and justifying an analysis. 


The process can aid in identifying who the 
decision maker actually should be, for a 
given problen, once alternatives and 
outcomes are laid out. The person most 
affected by (and affecting) the system then 


more easily can be identified. 


The decison maker's preferences for various 
outcomes can be separated from his judge- 
ments about probabilities, using this 
technigue. 


d) Weaknesses: 


1) 


ii) 


iii) 


Emphasis on the construction of a disci- 
plined structure (payoff matrix or decision 
tree) may divert attention from the value of 
creative inputs to problem solving. This 
analytical pattern of thinking does not take 
advantage of other styles of thought, such 


as intuitive, lateral, and imaginative. 


It 1s easy to oversimplify a problem during 
its decomposition into manayeable pieces. 
This is especially true in utility function 
assessnent, where simple, contrived gques- 
tions may be used to elicit relative values 
in some usable form--when the values actu- 
ally are much more complex than the process 


would indicate. 


Analysing the wrong problen 1s a real 


hazard. The decision analyst seldom is the 


166 


decision maker. .The analyst must take great 
care to learn precisely the nature of the 
problem being faced. Otherwise, he may 
seize on some facit of the situation that 
interests him (and that he can handle) --but 


that is of no real concern to the client. 


iv) Independence of variables 1s rare, in the 
real world. It may be necessary to parti- 
tion uncertain quantities into categories 
that then may be nearly independent. Our 
mathematical transformations Sometimes may 
be used (for example, using differences 
between values rather than the values then- 
selves), which more nearly meet the require- 


ments of independence. 


v) Utility functions are not always linear, in 
real life. A given risk when a person is at 
one state ina system ("I'm broke anyway") 
Will be viewed differently than when at 
another state ("I'n already confortably 
off"). Also, differences between utility 
values usually express merely the rank of an 
outcome, not the ace Ud. PEODOLEtienmay 


strengths of preference. 


vi) Utilities are not comparable from person to 
person. A utility function is a personal 
statement of an individual's risk attitude, 
and cannot be aggregated with the utility 
function of another individual without the 


use of normalization techniques. 


e) Procedures: Not all of the procedures listed here 


will be applicable (in this exact forn) jeroye iLL 
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decision problems. The user must select those 


that are appropriate to his situation, and revise 


the steps as necessary. This general procedure is 


illustrated below in the example. 


1) 


5) 


134) 


iy 


Define the problem; what is tae immediate 
decision to be made? Determine that choices 
among alternatives are reguired, and that 
some measure of effectiveness and criterion 
of a satisfactory solution can be found. 
Check that the required assumptions can be 
(approximately) met. Strip away irrelevant 
factors from the Situation and systen. 
Determine who the actual decision maker 
should be. 


Set the time horizon which will be consid- 
ered for this study. Will we begin with the 
situation right now, and look at’ the next 
two days? Or might we begin with hypothet- 
ical states five years hence, and consider 


the period of the following 20 years? 


Determine whether this is a single-stage or 
multiple-stage decision. After the problem 
has been laid out, will we make one decision 
and be done? Or will a series of decisions 
be made, each relying on the preceding deci- 
S1on? If multiple-stage, lay out the 


sequence in which choices will be made. 


List the alternative courses of action open 
to the decision maker. Be aS comprehensive 
as possible; less useful options can be 
eliminated as we go along. Remember that 


"do nothing" and "delay the decision" also 
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v) 


vi) 


vil) 


Viil) 


1x) 


are alternative courses of action. Insofar 
as possible, the alternatives should be 


mutually exclusive. 


Lay out the events that possibly may occur, 
in their expected sequence. These events 
will determine the "state of nature" of the 
system by their occurrence. Decide if this 
will be a decision under certainty, under 


risk, or under uncertainty. 


If this will bea decision under risk, 
assign probabilities to the occurrence of 
each of the above events. These probabili- 
ties should be based on available data, or 


oh some logical process of determination. 


List all possible outcomes that can result 
from the above-noted alternatives and the 
possible events. If possible, state these 
in terms of payoffs--though not necessarily 
in money alone. Remember that payoffs can 
be negative as well as positive. 


If possible, express the relationships 
between alternatives/events and their 


resulting outcomes in the form of a mathe- 


matical equation or other function. This 
will be easiest for decisions under 
certainty. A logical flow diagram can be 


used 1£ numbers cannot be assigned to the 
various parameters, showing relationships in 


time. 


Determine the utility value for each listed 


outcome, based on the decision maker's value 
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x) 


X1) 


systen. Ifa number of attributes of each 
outcome must be considered in valuing it 
(cost, weight, color, size), this must be 
considered a multi-attribute utili 
probien. It will be necessary to add extra 
Sub-steps here to combine these into a 
Single, useful utility function--a process 
beyond the scope of this presentation (see 
References and Texts below for books that 
cover this situation). It is preferable to 
choose one significant, humerical result 
that easily can be determined and ranked 
(Such as profit or time saved). This 
utility value may be considered the measure 
of effectiveness, or it may be some function 
of the MOE (which then also must ke defined 
here). 


Set the aspiration level, Or Criterion seen 


satisfaction, success, or usefulness, based 


‘on the MOE, outcome, and/or utility values. 


Early determination of this criterion, 
before the actual analysis begins, lessens 
the chance of biasing criterion point selec- 


tion by knowledge of "what is possible". 


Prepare a payoff matrix incorporating the 
above information (See Figure 8.1 for an 
example). The various events that may occur 
are listed at the top of the matrix, along 
With their respective probabilities of 
occurrence. Down the ileft side are listed 
the alternatives from which the decision 
maker may choose. The body of the matrix 


contains the payoffs which result from each 
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X11) 


xa} 


Xiv) 


pairing of aiternative and event. The 
completed matrix organizes the information 
needed to make a decision into a convenient 
form for beginning the analysis. If this is 
a multiple-stage problen and parameters 
differ for the various stages, a separate 
payoff matrix may be needed for each stage. 


Check the payoff matrix for dominance. Le 
one alternative is as good as or better than 
another under all states resulting from the 
events, the dominated alternative should be 
eliminated from the analysis. 


For a multiple-stage problen, draw a deci- 
Sion tree similar to that shown in Figure 
Bere s In such a diagram, time moves fron 
Temi to. Laight. A square box indicates a 
decision point, where the derision maker 
chooses one of his alternatives. A circle 
denotes a chance point, where an event 
outside the decision maker's control occurs 
(or its pre-existence comes to light). 
Branches and twigs represent the alternative 
paths leading to the various outcomes--with 
the outcomes themselves at the ends of the 
twigs. Probabilities are noted ailiong the 


branches and twigs, wherever they apply. 


The completed decision tree now is used to 
determine a strategy which will achieve the 
aspiration level or criterion set earlier. 
If more than one alternative path results in 
a satisfactory outcome, the first one 


encountered may be selected Or all 
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1) 


11) 


1 235) 


strategies may be evaluated and the one 


yielding the "best" outcome May be choosen. 


A fighter aircraft is on a combat air patrol 
(CAP) mission, protecting a carrier worth $2 
biliwen: Replacement cost for the aircraft 
itself and for similar friendly aircraft is 
325 Maden. It carries long-range and 
short-range air-to-air missiles (each 
costing about $1 million), and also carries 
an internal gun (negligible cost per 
encounter). 


The fighter 1S eguipped with an automatic 
target recognition system which can tell the 
pilot whether an observed aiccratt ee 
friendly or hostile with 90% probability, 
when in range. He also knows that 70% of 
the aircraft in the area are friendly and 
that 30 % are hostile, from pre-briefed 
information. 


The pilot has observed an aircraft beyond 

the range of his target recognition systen. 

He has four alternatives: 

e assume it is a friendly aircraft and 
continue his patrol pattern, 

e assume it is an enemy and fire a  long- 
range missiie at it immediately, 

e approach closer for better identification 
and use his short-range missiles on itif 
it is an enemy (with 20% chance he will be 


downed himself), 
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e approach close enough for positive identi- 
fication and attack with his aircraft gun 
(with 50% chance he will be downed 
himself). 


Procedures: 


1) 


ii) 


111) 


iv) 


v) 


vi) 


As defined above, the pilot must be the 
decision maker, choosing one of the four 


alternatives. 


The time frame for this decision is the next 
few seconds, during which one of the alter- 


natives (which are considered to be exhaus- 


tive and mutually exclusive) must be 
selected. 

This 1S a multiple-stage problen. If one 
alternative is considered "to delay", a 
second decision point will be reached. Aet 


this point, the pilot must decide to use his 
Short-range missile, or to delay further and 


use his gun. 


The alternatives open to the pilot are 


listed above. 


The events (world states) are: 

e the approaching aircraft is either enemy 
or friendly, 

e the pilot either downs the approaching 
aircraft or iS himself downed (if it is an 
enemy). We will make the simplifying 
assumption that, as a result, his carrier 


is destroyed. 


This is a decision under risk. The prob- 


abilities of the above events are based on 


Vis 


Vil) 


the stage of the decision problem, as noted 
above; i.e., the probability that the pilot 
himself is downed is zero if he fires imme- 
diately, is 20% if he delays anduses a 
short-range missile, and is 50% if he delays 
and uses his gun. The probability that he 
fires on a friendly aircraft is 70% if he 
fires now, 10% if he delays, and zero if he 


waits for positive identification. 


There are eight possible outcomes: 

e the aircraft is friendly and he chooses to 
continue on patrol (cost: nothing); 

e the aircraft is hostile, he continues on 
patrol, and his carrier is attacked and 
destroyed (cost: $2 billion); 

e the aircraft is friendly and he fires his 
long-range missile at it (cost: $1 million 
for the missile + $25 million for the 
destroyed friendly arrcrar t = $26 
miilion) ; 

e the aircraft is hostile and he destroys it 
with his long-range missile (cost: $1 
milion for the missile); 

e the aircraft is friendly, the target 
detection system says it is hostile, and 
he destroys it with his short-range 
missile (cost: $26 million); 

e the aircraft is hostile, and he has an 80% 
chance of surviving to destroy it with his 
Short-range missile and a 20% chance both 
he and his ship will be destroyed 
(expected cost, based on probabilies: 
( (0.8) ($1 million) that he kills the 
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enemy] + [ (0.2) ($2025 million) that he and 
Ship are killed} = $406 million) ; 

e the aircraft is friendly, and he kills it 
with his gun (cost: $25 million, except 
this event will occur with Zero 
Dmoradility) ; 

e the aircraft is hostile, and he has a 50% 
Chance of surviving to kill it (at negli- 
gible cost) anda 50% chance it destroys 
both him and his ship (expected cost, 
based on probabilities: ( (OSSye(s2025 
ne iton) ) = 5 Onan 1 boon) . 


viii) For purposes of this study, money will be 


1x) 


x) 


considered to be the payoff, with mininun 
cost to be considered the utility value and 
MOE. 


Aspiration level for this problem will te an 
expected loss (based on probabilities of 
occurrence) no greater than $500 million--a 
highly artificial situation, on the surface. 
However, it 1s convenient for demonstration 


of this technique. 


Both a payoff matrix (Figure 8.1) and a 
decision tree (figure 8.2) are useful to 
structure the Situation BOE analysis 
(although each shows essentially all of the 
information--in different forms). From the 


“Matrix we can determine that none of the 


alternatives exhibits dominance over any 
other. Thus they all will be retained for 


consideration. 
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Probabilit Enemy Friendly | 
age 1G e 0.7 
Stage 2 0.9 0.1 i 
Stages 18 0.0 | 
| Probability State-of-the-world | 
BSG Alternative COSt,™ 
downs him actions Enemy Friendly EMV 
Ca Do nothing 2000 0 -600 
0.0 Shoot now 1 Zc - 18.5} 
0.2 Short-range missile 406 26 - 368 | 


Figure 8.1 


Xi) 


Payoff Matrix for the Example Problen 


Although the problem could be evaluated in 
several ways, it will be useful to use the 
concept of expected monetary value (EMV) 
here. Remembering that cost is a negative 
value, we make use of the expected costs 
calculated above for each of the eight 
outcomes. The cost of that outcome is 
multiplied by the probability of that 
outcome occurring, to obtain an expected 
outcome value. Then these expected values 
are summed for a given alternative. 
e do nothing: GOs probability 2 (me 
hostile) (2000 cost) ] + [ (0.7 probability 


it is friendly) (0 cost) ] = -600 EMV; 

e shoot now: (0.3 “Srorabi lity it Ge 
hostile) (1 cost) j] * [{ (0.7 probability a2 
Ls friendly) (Zoveost) e--- 10.5 Env: 
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Decision Tree for the Example Probler 


e use short-range missile: [ (0.9 probability 
it is hostile) (406 cost) ] [(0.1 prob- 
ability it is friendly) (26 cost) ] = -368 
EMV; 

e use gun; [ (1.0 probability THe is 
hostile) (1012 cost) ] + [{(0.0 probability 
it is friendly) (25 cost) ] = -1012 EMV. 


Xii) Making use of our aspiration level, we now 
can see that two alternatives are satisfac- 
COL: Shoot now (at an expected cost of 
218.5 mailionye or use the short-range 


Missile (expected cost of $368 million). 


c) Caveat: This example points up the importance of 


b) 


Cc) 


choosing a good measure of effectiveness for 
determining the usefulness of a decision. 
Obviously shooting down a friendly aircraft is 
considerably less desirable than cost/value alone 
would indicate. Some multi-attribute utility 
probably should be developed that would include 
such concepts as morale and the loss of life. 


Findler, N.V., Sicherman, G.L., and McCall, Bede. 
A. Multi strateqy Gamin Enviroment. State 
University or New York, uffatlo, NY, March 1982 
(GCSS-TR-9, GCSS-TR-196, AD-A115° 380) . j 

. Human recognition behavior and machine 
intellegence-oriented, competative strategies are 
used to study how decisions are made under uncer- 
tainty and risk. Work on automatic analysis and 
synthesis of strategies also is described. 


Puscheck, H.C. "Sequential Decision Making in a 
Conilict Environment", Human Factors, Vol. 14, No. 
6, 1972, poe sS6t ora ; 

A two-Sided wargame simulation was developed, 
to study game-playing Se Four decision- 
Making models also were developed, to play one 
Side of the game. 


Rouse, W.B. A Thee of Human Decisionmaking in 
Stochastic Estimation Tasks", [TEEE Transactions om 
a Man, and Cybernetics, Vol. 7, No. 4G, 
A977, ppa2y aoe 


VS 


Concepts from stochastic estimation theory are 
used to develop a theory of human decision makin 
that employs optimal stochastic estimators wit 
short-term and long-term memory models and esti- 
mates tradeoffs. 7 7 


Gilet Ov 1 Cyelaw,  rischhoff,@Baruch, and Lachtenstein 
Sarah. Behavioral Decision pe Suk ts Decisions and 
Dear goa Tne., McLean, VA, September 1976 (AD-A036 

survey of the field to determine what is 
known, what it is good for, . and what else must be 
learned, _with emphasis on research on how people 
do make decisions versus how they should make 
decisions. : 


ee) 


EFERENCES AND TEXTS: 
a) Bunn, D.W.. Applied Decision Analvsis. New York: 

McGraw-Hill Book Company, T9849. 

A clear and complete short text on how_to use 
decision analysis techniques. Good section on 
multi-attribute utility problems, though more 
mathematical than Raifia's explanations. 


fs 





b) Raiffa, Howard. Deci Biysts: Inbeoductory 
Lectures on Choices Under Uncertainty. eading, 
ee age be Aue tS eng Company, 1968. 

A delightful . short text, very readable. 
Excellent continuing example used to demonstrate 
the procedures. Includes choices under risk, as 
well as those under uncertainty. 


sion An 
naer Un 





6G) SheGidenm, 15535, and@itemrell, Wek.  Nan-Machine 
systems: information, Contorl, and Decision Models 
Ot Human Perrtormance. Cambridge, Mass.: The iT 
Press, 1974, T9ST. ss ap: 
Discussion of utilities of dynamic decision 
making, and of games, ina fheoretical framework. 
d) Williams, J.D. The Compleat Strategyst. New 


York: McGraw-Hill Book Company, 1954. 

This 1s the claSsic primer on gan theory and 
game strategy. . _ Intended for the non 
mathematician, it is Pogue reading, while being 
a Reaeecnensive loo at the uses of payofi 
matrices. 


Be. SIGNAL DETECTION THEORY MODELS 


Fs 


PURPOSE OF MOLEL/TECHNIOUE: Describing the prob- 
ability or percent of time that two classes of events 
wili be discriminated by an observer. A relative 


operating Characteristic (ROC) curve is used to show 


Tae 


a cross plot of hit rate versus false-alarm rate, for 


a given situation and observer population. 


Sea 


For example, a series of observers may be shown fuzzy 


CRT images of ships, in a laboratory, and told to 
identify each as friendly of hostile. Their 
responses are classed as; correct identification as 


hostile (hit), correct identification as not hostile 
(correct rejection), incorrect response as non- 
hostile (miss), and incorrect response as hostile 
(false alarm). The proportions of the various 
responses under laboratory conditions are used to 
prepare a ROC curve. This then will be used to 
predict how good ship identificaiton performance will 
be under real-world conditions with similarly fuzzy 
images from TV system on a tactical fighter aircraft. 


MATHEMATICAL TOOLS REQUIRED OR USEFUL: 
a) Algebra 

b) Probability theory 

c) Descriptive statistics 


d) Graphs and plots 


HUMAN FACTORS APPLICATIONS: 

a) Describing individual differences, such as- the 
relative proportion of hits, misses, et co, 
observed in given population groups, or individual 
differences in sensitivity versus decision 


GLEIlCCE La. 


b) Describing systems, such as’ the relative propor- 
tion of hits, misses, etc., observed in operators 


using two different systems. 


c) Designing systems, when a choice must be made 
between systems, based on observers' trelative 


accuracy of discrimination with then. 
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d) 


Evaluating human performance, where it is neces- 
sary for observers to meet some criterion or aspi- 
ration level which can be described and defined 


easily in Signal detection theory terms. 


USED IN LITERATURE: 


a) 


b) 


Cc) 


d) 


e) 


Blignaut, C.J.H. "The Perception of Hazard. iirc 
The Contribution of, Signal Detection to Hazard 
Perception", Engonomaes, Vol. 22, No. 11, 1979, 
pp. 1177-1183. , == 

_ The ability of. mine workers to discriminate 
visually between dangerous and safe rock_.condi- 
tions waS. examined. Responses to stimuli were 
analysed in terms of eae detection theory, an 
results indicate tha experience and skids 
training improve performance. 


Boone, aoe. eee Vp Visual Differences 
between. Geometrically Sa lziary Bard how and 
Low-~Accident Rural Roadway Curves", Proceedings of 
the 23rd Annual wWeeting of the Human Factors 
Wecilety, Boston, MA, T3979, pp. 267-277. 

An accident causation model, based on the 
theory of signal detection, is developed. 
Differences in drivers! visual perception of 
curves is used, along with driving experience. 


Eubanks, J.L., and Kiileen, P.R. "An Application 
of . Signal Detection Theory to 15 Combat 
Boe ee WaGmems, Vole 25, NO. 4, 1983, 
ie Signal detection theory was used to study 
Ghanges in pilet decision makin behavior as a 
function of training time. Pie erformance was 
Separated into distinct. and theore seine | OLtneg= 
onal measures of sSensitivity/accuracy (d‘') and 
response criterion (£). 


Pastore, RoE., and Scheirer, C.J. So emad 
Detection Theory: Considerations for General 
Application, " Psychological Pupeetin, Vols. 81, 
NOs 2, I974,. pp- Dao 


The assumptions, procedures, limitations and 
ractical considerations relevant to Signal detec- 
jon, theory are summarized, and application to 

cognitive processes 1s described. 


Young, J.-M. The Effe 
ctabi Wie eVeresg 


Detec ee ~ Traco GiCosmuustin, Tr, Aprmid 
Toeomere me On—-68-591-U, AD-AO71 770). Dee 
An experimental determination of probability of 


ct of Signal Incidence Upon 
g 


detection, asa function of signal incidence, 
Showed that the probability of detection decreases 
linearly but cremains finite, as Signal incidence 


1s reduced and approaches zero. 
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j ,. TeBe, “Wandeharrely, 
Systems: Tnformation, Contorl, a 
~£ Human Perrormance. Cambridg 
Press, 197 = : 
A complete theoretical treatment of the 
subect : with a little information on 
applications. 


b) Welford, A.T. Skilled Performance: Perceptual and 
Motor skilis. GlIenvill, Ill.: Scott, Foresman and 


Canaan : ; ; 

learly written, brief discussion of the theor 
and its application to decision making an 
performance. 
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IX. SUNMARY 

This thesis is intended as a primer for human factors 
engineers who wish to understand and make use of applicable 
models and techniques used in operations research. Nineteen 
of these techniques are listed here. Seven are discussed in 
detail, including illustrative examples related to human 
factors and to military systems. The other 12 are described 
briefly. Possible uses are noted, and sources of further 
information provided. 

An extensive literature search was conducted as part of 
this. study. It is interesting that numerous reports and 
other publications had keywords indicating that operations 
research and human factors were being combined. in ae eu 
ality, however, these reports usually involved one or the 
other; rarely were both tied together. The logical pairing 
of these fields was pointed out in 1970 by DeGreene 
[Ref. 47], yet little progress has been made in the inter- 
vening years. And what has been done mostly is written by 
operations research analysts, and 1S unreadable by most 
(mathematically unsophisticated) human factors engineers. 

The most valuable thing obtained from this study is 
strong evidence that many operations research techniyues 
indeed can be useful in modeling human performance. Markov 
chains, queueing processes, and simulations all provide 
useful insights, along with linear programming, networks, 
and distribution nodels. The human factors engineer is 
strongly encouraged to consider whether one or more of these 
Might be useful to hin, as he goes about his job of 
describing people and systems, designing new systems, and 


evaluating performance. 
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Perhaps the most useful (and overlooked) techniques, 
overall, derive from decision theory. These models are 
relatively easy to use. Algebra and some understanding of 
logic and sets is useful, but otherwise little mathematical 
sophistication is required. Yet the straightforward devel- 
opment of payoff matrices and decision trees iS a marvelous 
way to clarify a set of alternatives, and enable selection 


of one that will be satisfactory. It is highly recommended. 
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APPENDIX A 
GLOSSARY 


Air Combat ee (ACM): air battles between two or 
more fighter aircraft. 


megorithm: a set of logical and mathematical operations 
performed in an orderly, specific sequence, usually using 
a computer. i 


Analogy: .viewing a new problem as if it were .an old problen 
for which one has insight or a solution, in order to use 
available tools. 


Analysis: the separation of a whole into its component 
arts, usually in order to understand its nature and to 
etermine its essential features. 


Analyst: a person who uses the technigues and tools of anal- 
ysis. 


Arithmetic operators: SES which indicate a process that 
1s to be carried out on two or more numbers’ or other 
characters, or a relationship between them, such as +t, -, 
=, Or an integration sign. 


Continuous: variables which can take on a continuun of 
possible values. 


Descriptive model: a_model giving a description of a systen 


or process, usually in mathematical or other symrolic 
terms. 
Deterministic: a model or process that give an "exact" 


answer that 1s, one that yields a numbér or numbers as 
its end DEOadUCt . 


Discrete: variables which can take on only a finite or 
countable number of values. 


Event: any subset of the set of all possible outcomes or 
occurrances in an experiment, study, or any other process 
being followed. 


Exhaustive; . enumeration of all possible states or events in 
a Situation of interest. 


Human Factors (HF): the study of human capabilities. and 
limitations in Ber ora work activities, plus SS 
tion of this knowledge to design of equipment, ayer bt LS 
ties, ..and environments, and to the enhancement of 
capabilities EhBough #training. 


Human Pactors Engineering tees aa ee doy of human 
factors which emphasizes design of Soe , acilities, 
and environments to match the capabilities and limita- 
tions of people. 


Iteration: the Sone of operations (usually in an algo- 
Cithm) leading fo a new and (hopefully) better solution. 


lors 


Linears a "straight-line" relationship among variables, so 
that contributions of the variables are “proportional to 
their values, constant over the possible range of values, 
and additive. _ | 

Man-Machine system: an entity consisting of human and non- 
human components which exists to carry out some puree 
which transcends the individual purposes of these 
components. 


Mathematical tool: a mathematical procedure which does not, 
in and of itself, answer a systems oF organization ques- 
tion, but which is needed in order to uSe an operafions 
research technique. 


Measure Of Effectiveness oP ie criteria of overall system 
performance used to evaluate proposals and designs; 
usually measurable, numerical values when possible. 


Mechanistic: another term for deterministic. 


Models: more or less abstract representation (physical, math- 
ematical, and/or verbal) of a system or subSysten, used 
to define that system sufficiently well to answer ques- 
tions about it using various techniques. 


Mutually exclusive: enumeration of a set of states or events 
which do not overlap (are orthogonal). 


Operations analysis: analysis, of the operation of an 
oxioe ne system; often uSed interchangeably with systems 
analysis. 


Operations Kesearch (OR): Application of the technigues of 
the behavioral Sciences and mathematics to models, in 
order to make tradeoffs in, solve problems of, or make 
decisions about complex problems (usually concerning 
organizations or systems). 


Operations research technique: a procedure that clarifies a 
Sree ELS question about a system, condition, or event, or 
that ives a@ quantitative answer to such a question, 
through operations on a model. 


Optimum; the most favorable value obtainable, or the best 
possible solution to a problem, within given constraints; 
one that maximizes some measure of benefit oLr minimizes 
some measure of cost. 


Paracigm: a model. or pee. tears is widely accepted and 
recognized within a given field. 


Prescriptive model: a model that prescribes a course of 
action needed to obtain a desired outcome. 


- Probabilistic: a model or_process that yields probabilities 
of occurrance as its end product. 


eset fe ants EES method: an orderly, step-wise approach to solu- 
ion of a roblen, aid out in a logical sequence (not 
directly related to computer programming). 


Quantitative: the degree or level of some quality or attri- 
ute, including fumerical values, probabilities, and 
ordinal comparisons. 


Sensitivity analysis: evaluation of how. a given optinun 
solution would change if input data values were changed; 
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used to determine the range within which input values can 
vary and still yield a satisfactory solution. 


State: the condition or status _ of an object of ee as 
ave 


a result of its initial conditions and events which 
occurred subsequently. 


Stochastic: a time-related probabilistic model or process. 


BeOppang rule; carefully specified, conditions, _used durin 


Syst 


e iteration process of obtaining better Solutions, 1 
order to recognize when the present solution is "good 
enough", and iterations should stop. 


-eM:..__an assemblage of constituents. that interact_ to 
fulfill a _common purpose, transcending the individual 
purposes of the components. 


Systems analysis: the scientific discipline of_ analysing 


systems by examining their component parts and the frela- 
tionships among them, in order to solve system problems. 


Systems engineering: Be es ELD of scientific and engi- 
2 


heering knowledge to anning, design, evaluation, and 
construction of systems. 


187 


10h 


17. 


Zz 


eis 


LIST OF REFERENCES 


DeGreene, Kenyon B. Systems Psychology. New York: 


McGraw-Hill Book Company¥~~ 1970, “3 B 

Cogan,Eugene A. "Interfaces Between Operations 
Research and Human Factors Research", Proceedings of 
the U.S. Army Operations Research SympoSi um Pare ae 
v.53. Army Wea pons Command, Rock Island, iL, ~25 Nay 
1964, p. 54. 

McCormick, E.J., and Sanders, M.S. Human Factors in 
eR 2neerind and Design. New York: McGraw-Hili, iInc., 

| oo 


Bailey, Robert W. Human Performance Engineering. New 


Jersey: Prentice-Hall, itnc., 1982, p. 22. 


Jones, D.B. "The Need for Quantification in Human 
Factors Engineering" resented to Sixth Reliability 
and Maintainability Eon erence, Cocoa Beach, Florida, 
duly 1/7, '967, ~Ppemo—o 

Chapanis, Alphonse. On Some Relations Between Human 
Engineering, Qperations Research, and Sy stems 
Engineering. SENS SSE ERE 2 Laboratory, Johns Hopkins 
University, Way 13, 1960, p. 47. 


DeGreene, p. 7. 
Ghapanis, peo. 


Morris, William fT. "On the Art of Modeling", 
Management Science, Vol. 13 (1967) 7 spo. B/0/-57ige 


Daellenbach, H.G., George, J.-A, and MeNickte, peee 
Introduction to Operations Research Techniques, Second 
Edition. Boston: lyn G Bacon; minc.) © \3oep epee 
DeGreene, p. 80. 

Raiffa, Howard. Decision 


on Ana lYSis: introductor 
Lectures _on Choices Under Uncertainty Reading 
Solo Addison-Wesley Publishing 968 Dp 


DeGreene, pp. 81-85. 


188 


14. 


15. 


16. 
7s 
18. 


19. 


20. 


Zi. 


oo. 


23. 


24. 


2D. 


26. 


Aus 


25. 


2°. 


Hepat, Ps 90. 


iiiitiet, sho. , anc Lieberman, G.L. Introduction to 
O ed Research. San Francisco: Holden-Day, Inc., 
s Pe ° . 


Chapanis, p. Bae 
Daellenbach and others, p. 2. 
Totd., Ps O40. 


Wagner, Harvey M. Principles of Operations Research. 
New Jersey: Prentice-Hall, Inc., 1975, p. 3. 


Naval Weapons Center, China Lake, Technical Memorandun 
Sees The Human Operator and System Effectiveness, by 


Prieksompasuly (933. 
Chapanis, pp. 61-67. 


Raben, Margaret W. A Survey of Operations and Systems 
Research Literature. Institute for Applied 


a a ee ey Tufts University, January 1, 
Pe. Se 


Rand Corporaticn, HoicdeiOnmea, Report. M-16/78, An 
tptpoduc tion to Systems Analysis, by M."N. Hoag, April 


Wagner,.p. /. 


Kantowitz, 8B 
Understanding 
John Wiley an 


He,» “anideeoOEK ly R.D.  $Human Fa : 
Peo oS Seu Relationships. New York: 
dvsons, 'Ie3, pp. 15-17. 


Rouse, William B. System Engineering Mod 
Human-Machine Interaction. New York Else 
HOmmdtwagmincs,, IWO0, p. S&S. 


Tee pb. 120. 


Daellenbach and others, op. 
J.C.D., "Models and Manage 
Caléuluss, Management SCi 


14, guoting from Little, 
rs: Concepts of a Decision 
ence, April, 1970, pp- 


B466-B485. 

METEORS Introduction to Probability Theory and 
Statistical Inference, Third Edition. New York: John 
Wlevyeanad s0ns, I33Z2, p. 20. 


30. 


Si. 


32. 


Sic 


34. 


5 ]3) c 


36. 


Si 


30 


39. 


40. 


oie 


42. 


us 


Gu. 


45. 


4E. 


47. 


ROUSC?. > .aece 

Ifoskslen de is 

Daellenbach and others, p. 15. 
iitse, De Iece 


sinclair, H.A=, and ee ¢ E.G "On Mathematical 
ae aa in oe Applied Ergonomics, Vol. 10, 
No. 19, Pie 225-245 


Olkia Ingran, Glaser, Ld sic and Derman, Cyr use 
Probabilit aby Models and dveatious. New ork: 
Macnilian Publishing Co., 13 Pape - 2a 


Daellenbach and others, pp. 21-22. 
MOETIS, pe By Vice 

Daellenbach and others, p. 23. 
Tpid., Dsews 


Rouse, pe. 6. 


Nie, N.H., and others. SESS pe ota tistigal Package for 
the Social Sciences, Second Edition. WNew York: McGraw 
Hill Book Company, iowoe ey =) ec 

Bland, Robert G. "The Allocation of Resources by 
Linear Programming," Scientific American, Vol. 244, 
No. 6, June 1981, pp. T2Z6=-Taq.” 

agel, S.S., and Neef Marian. Operations Research 
UeEhods. Beverly Hilis: Sage Publications, 1976, p. 


Daellenbach and others, p. 38. 
Daellenbach and others, p. 189. 
Reagzita, pp. Zotez92. 


Degreene, p. 98. 


INITIAL DISTRIBUTION LIST 


No. Copies 


Defense Technical Information Center 2 
Cameron Station 
Alexandria, VA 22304-6145 


aera ys Code _0 142 2 
Naval Cees tans School 
Monterey, CA 93943-5100 


CDR C.W. Hutchins 1 
Code 55 (Hu 

Naval Postgraduate School 
Monterey, CA 93943-5100 
tee Gals Landsa y 1 
Code 55 (Ls) 

Naval Postgraduate §S 
Monterey, CA 93943-5 


LCDR P.A. Sandoz 1 
Code 03 


= 
on 


Naval Postgraduate §S 
Monterey, CA 93943-5 


Judith 4. Lind 5 
Code 3152 

Naval Weapons Center 

China Lake, CA 93555 


Human Factors Branch 6 
Code 3152 

Naval Weapons .Center 

China Lake, CA 93555 


eee. Weapons Integration Department 1 
ode 

Naval Weapons Center 

China Lake, CA 93555 


=—Q 
or 


Targeting Division 1 
Codé 315 

Naval Weapons Center 

China Lake, CA 93555 


NSAP/NSTEP Program Office 1 
Code Q1A2 

Naval Weapons Center 

Chima take, CA 93555 


Techhical Library 4 
Code 343 

Naval Weapons Center 

China Lake, CA 93555 


Stephen Merriman 1 
Code 6022 

Naval Air OS he Center 

Warminster, PA 18974 


19 1 


135 


14. 


15. 


16. 


CDR Tim Singer 
Code 6085 

Naval Air Development Center 
Warminster, PA 18974 

Alfonso Calero Espinosa 
CUAN ~ A2-E3-APTO. 1 
Bogota - Columbia 

South America 


ALDCELO. Caste 

Edificio C=-6 De cto 501 

Unidad ISSFAM Délegacion Titlpan 
Mexico D.F. 


OS 
02 


Bem ay oa bean 

Seep aaa OS 

21111 Erwin 

Woodland qpiis: CA 91367 


Vor 











14G_tl] , 5 














Ate 


08 NEA YG” " 
6 4:0 in b a © 
Le Pan fs ae A aoe 








Ur § £84 wae Sey y 
oe ty exe! rae 











































é Pf Pie Oia tg os 















Hein MTT - ‘¢ ; ; i : 
Bees Wh | hh : | ‘Wy | ao =e 
stan aaa Se AACE a 
Apo arois is AI We AAI 


7 ¢ a : . 
thesL642 
SOO CURAAL Ae a 
‘ Lee PO PGR 4 | 
te 98 O° B+6 C.0.e 6.58. es j 
wae HLuteo «@ 
gh 456 A ' 4 s 
i CEP ey area eee Fd : \ 65237 4 | - : ‘ ' 
O . ; ‘ ' ' ’ 
AL AUN POLL anh ane Yani £2 3 2768 00 .: 
Scheme ys Os As wd We £0"AN« y 
4.846 army P's BFF tee 0 af ri A ¢" 
ff SUeweana’y wea és avs 
= . ee Se ee ae , f 
HOON 4h 00 Bed 9: ; 


, s for human 
; eta | earch technique 
Fry tied wot pe ate! ere a i? Operations hs 
PROD tama d eer 4 | 
& @ Alara y Buet b~¢ | 
Pens « hb al 480944 
AG sad 9 G4 x et " 
ARY | es 
E ae NS TR Pirie DUDLEY KNOX LIBR , | 
6 6 Uae 
een ey kw Eee 












































































































































































































’ 
. ; 4 ‘ ‘ 
ot : 
as rae . . = J 
EAA aey Line a a 2 2; Rise e's ' 
1 tdety sy O'S as geitta teen 4 . "4 - ' ® 
Ot ek A hie ds ik ee aah ate, £% Sean Pop ie ee Anh P'S asane ‘ "es ' 4 ‘ ' ’ , 
adn e apy hho bate tah) OWS Oy ieee Rees aig wed oltre py stig Ch ae | ' ' ’ ' ' 
Cb 82 04 44a bs rte Ra ee a POeaaed nee at hk Se Oe ae We eer ‘ MB : : 
pada SUr Sd & VE 6 art am CBU PE tee eee ee re ete 446-€3r rhe yy A i . 
Se tA wet 6g GAM A Det 9 4 wt Gaara) SO OP NORTE PO Me way od Be Copa y Amada ‘ ‘ de ' ‘ 
- (AF oO oe A of or 8. 8 64 A CU OH au Cs a UA $00. O Men te dat he 2 oe Get aay ' s . Pr U ‘ e 
Meh e wh Fed, dit BOOKS 4 aekie ae A Hes’ & 2, tetas hee gw 4) hese Sho waa @ 5 : i . 
TM w ee OF OAH DOV OEE 88. bed nk. oo PA OM Bre te yD OS 1 Oe Gh ve fn Sh eA ' 1 +e : ‘ 
lasek aie HAO oe hl CA OG ecaie ad bee + nde OCR OU es 8, ohn ' ' ‘ ‘ ' nee 
pee ae hep Oo TS Ee fey AMeENUEA EIS BG awa' ‘ta fe as ee ' ony ‘ee 
fat Sat + bimbo a sof A ELE ay ee On ae BO CPR ae eet os hr WY a Ge a) ’ : : 
GAs Shdwilet aa dy i ae a oe rere | er rl ‘ : os o6 ‘ ' . 
t Fmd Hatt lads ' 0a da ee lan so m4 . . a | , 2 : 
On Pat tga ith Astuog ore hy Poe Ot ae ee ; ‘ . 
COMA Nh te $A edd tana WES pags A ee a a ee sfch ; A giti- 5 ‘ ' . , 
og ae ae Le Se ee wt C429 ha Ua SWE lL, Rene ge Bil DIME a Ons wt ale 1 . 4 i ' 
Ae ee ee erin STA we wh i OL ae ood 4 Pee tt 0 ag a | . : ‘ F ’ os . 
Ait ROM)” 489 mes wet ae ene UAH 8 A MOA wm Pe st ain MASP snag u sy WA tus Niven ’ ' a . 
Pd Re eee SPM CAE aA nw re eo a) o8 6 * . . . a . . ’ . 
Maem CON A Veins able hod TET) ee ho Ve argon 2 Og trig se IGOR ei oot Bk be A ( ees é Par 
CeO NAS 08.28 okt of : ‘BC Me Hoe Rn & weta ’ , a! Cn) . ‘ a ° , 7 
reine @ ets sva et Od Me LUAU A Gia 6 Otala @ fia thie s\; i é . . . ‘ ls er . 
a OS a Ot At a Og 4 bart Badin » ary ease . e ° ae ie 4 ' Gis es ; $ ' ‘ 4 
Vehewver a apte? © 6 L bh 4 a ert Cr wir wt A pik ot. he ‘ <> ie | hee hair ie oe i er ) ue Fy » % ' * s an ain ' Om . ' : we ¢ aC) i 
netted he dated ¢ ORR AM ae Jat et sey gg 73 RO Cas. 5 4 6 Pe ne ‘2 t« 4 Pung fire ” : te : ' wee pat 
EIR oR gp i hee wn aay sal esut,: - 4 i Sia @ pop bes Cl Pd a ae r ee 6.4 a | Fy ’ or ri) x e. s = : 
rare # dv aer av Aad ¢@ Mae Pies PaMt hoes a artir dy fee st big wy ate ote p ep ‘a's fos: %, “'¢ t » ‘ rar Wee aye ar erece Cama tt ohh A . sia | : 
Mees cS AOA Ae ag, ahs nn Ets Fore etetn en a, fase 2 2 wi! « Rot K 4 ea Si gaa a Oey Vhiae 49°32 ‘ rer f 2 ' ‘ ’ ° ‘ cs ' 
eran git te C6 seheels sity > WME LOE Za * Aan Liararee a fuels ¢,p Ce ae ae" 4 "0+. 4 <2 * P “<i ‘ oan o eek wa ‘ ' ¢ rar By , i 
1 Pen rwteeed aha ohva in «ol cya te f Cae Rae 8m tik ie af Pe On Oe ee eee sp: (a.onay CN ie heey tn 0 Oe CTC Ct ee tot Toa 2is Yo Wl Yay eo. Caer Ae) me) 3 ‘ ' Eee 8 ap 
arin ln « o De s fA Ot ontin th ag Cos Ey ete SSO, Mm td ew dat ‘en or we 5 as e: ie oe ee ar) Fi ‘ ae See rs i F : ia P A ‘ . . et . os 
Of ato $148. 908 te Benin 9. SORA oh ne EA geOw, 8 6 yes Fe ete FO a ea 4eaf "ey ton ar ee GCs, ot Ge Sa ee ’ 1G ge FR 1 ' ra ' ’ ' ' : 
ABs oO Ret age edn ola PE Ir Teer eae "O44 Dam oes 4c day # "2 “wt esaas ey eee) eects Ca ee ee Y SST Va ass Taree ar eee praia i er oe 6 4 ' ee, eC | cramer] o8 : 
abs A PANO Am ae 8 Gf SA ANE Oe 0 a4 Mette g ft Hate 4 gg Meise ht my Url mee ee Ja let LIN ier Me LAO Niet Teer ya iow. ‘ s ‘ ‘ Bees z ; 
at gabe Ae hal CA £2 Otel ii A gaa dtl, 10436 wal ¢ PABA NS oe s?@ LEE a Ue i la feenrsg’ a aL to (ace 1 ‘ Car) ' ' fod pia ' . LAN @ : : 
CA EAN ON of ne WFO tiie few Satter a, hy coe ree w+ rt hteard fan 2, Pee As gags. ¢ Firn tier "wets wwe (eerie of) toe On tenet oo . a i ' Es 
ok, MSedbiete SS OG Oke OA 8 tea nek a cg be N A “6 Whe ae ER sg fasta es PE ey tic pe teen fap LU OP aa eye Cnet ' es a ' . > ae ' US Samer : 
Di bie d Pals RELY Pe ry iis Add ee te et OM hs tee eer te . Ope hari ioe Ne ES UT oar eat Pit Poh ng ad cee s teri . ' : «5 .- ey 2 
Se ote Cit Sateen ne EPS POR Hid Bb mae nie! aly Phe 1 he 4 oe 4a Pee ery ’ rae ee Te ¢ We ance vue . e s * eae ‘ ' ‘ ' ‘ » 1 * 
Noe pared a tis TOF at wet g gon CHL AOA TL MOA Ge gd se hi ft éaasida, a Pier ‘ ; oh as i, *hetgy ’ ;. ' ‘ ° Part ' : ‘ . ' 
Ade Sus ett os ff ro PEM to oe of Og be “a ytd a fem @¢sa ig Sricien ove CT as CE eae Ning ' * , P ’ ) " oe ena . 
pe wne tele =O Wemaa: id ae a ea at are re fs aes” 80 oct oa gs ts fs oe 0 es ‘2 ge Fe . Oar 4 “4 ' A) ' : ' 
Sire aA As the d mainign StL, MSA tt 8 8 PNG 6 o's ca ; FoR alana ert ¥ragh mae ak Cee) ' ‘ to: . ‘ ‘ teas ‘ " aol c . 
tat MHEG Swe of red ae ae SAA ORF AMfiars uve, sd $5. aig , ‘ e ote es od ’ Par ib s et Ce ere . ’ ‘ * * . . 
ahah ek Maeda Pg fet ORE ald dhe deste o PO hee ese e,, ‘ sips S50) Mere ticimieccy Sie Mway us F os F ' ' . ; P Ls ‘ ‘ ' 
it Te LAP ORA AAA anns oe : el i ay ie et er DaeMbew lite) op w POMP te oe, SOUCY Ulam Jig Sen li eae Aerie By 5 e) <p s a: - e : " ‘ * te 9 
Meteo rt of a tek al eee ee AS 89 ad os. ~ Oh ae ae ey a ‘ fedveroon 5 te ey roe Sree eee ee Pattaya fia bis Rie Pe te Pa ’ ne * ' ‘ ‘ + ‘ 
Pr oenies @ AB belo a ¢ IPO) Ped gs send a Hae Seer & ne ’ te Ose) te ere! bcs ee ie tener ‘ i ' ‘ ieee ', [er Oe gle ' ’ <° A 
pati A fe 2 A Ak og as Aide 0s eng w 9 fe! Sete oy be oe hsg assay CSF. PF ake 8a oe oh ee i er 6% s 665 ete. ¢ 1 ¢ eo 6 elaine m4 Bighie 35 ig j 
Met AOE boSipigs ° 8S ard: Set daneedbir ofig. | ttt weet te ae tp Seem Ae tag ap tpt : ehets ‘ ae rae a os on (ie Pere ae iy eA Se ’ ’ : : : 
et AAR HAE 0m 15 ol Owl sho Pd te ot ome oe dy Pn © ee) eee Eee Rwre ang! ip: 2 0 ap aien pg ' le o. ‘ De ate al Cah S ete Sy gc tgs a 6 “ ° ‘ en . ‘ Bye ve tr . 
Ve TsO bm ds on Sart eraet-p Bet. ne» CA ST ROCCE a ier ik €.00 4d ' he CCK Tonk OCNGY At dO Ua lacy Por 29) 8 PS eg) yet LA Lue iden Oy 18) hwy ‘ mere are te ’ eos ne "8 $ : 
OOF tilt ae Ph aendedlaie TD el te Rk Cee dedbace Salgiaian on JCIETICR SU CICRCTRCE Merete hues ter F Ape URS soir ay ae ar ; ¢ reer . ! : 
Oe G88 aes 26 He ain eR A er ‘ Cee Pll a ng * ele ¢. 8 relaire . A Gh Sees ow) ooooN gt aia tye 1. oo ee Cee ' ee og 
hal alad cand fe PLY A. cae eae a a9 Re ae ad Paes b= Ae rr “ore ae ' ) (aaa vas F : Bigag oa ay ji ‘ ' ° 
° iB of ees Pi -uq © wh et +a et Fens Ora e Xs og, ties aR ania pi ip %e re ee a “ar 10 va ag mtd ° ‘ oe oe ' 
Pmt at HR 0 aye Puhste i OB ict ee tp A" 09 ot ; Wim a ag ae r " : . ieee Con ‘ a se 8 ' : 
et ob png UIT AEM TDG ean kee tees Sing os ieee ; ae , r , ' ren ' ‘ ms 
alk od FELMR dt or ge 2 PF bd ot ett SP bah hs ot sofas A - 6° 0 ye ita cen Fe a ae ’ ts ® 
"Mt Pid, Ph aa fo ee oe ee Wet Fe 1 megs, a want ‘ <ouas E Par me FPA ' ' oa) ' ' 
fe TUS toler at se de wud s . Peder on ma. © tp WAR yd . ahs . - : ", Re arnt : ' * 
Vt Pog i, ck oe eS ae tek -d it tee bs om ie ' ner Es a ' oo Og ’ ee 
PLEA Bin a aes pit abe Srlhad ad ee ee ae Wada ics & ‘ Fete ig rs oh oy <> ys ee as . . 
oF Figs FP Roy dour 1 FOP M OLE We fC, POR a . see re ° on sean ‘ : 
Ad aaa 2 PRG Bie SAE Bd odhins amreer Ae bac Sur ae : rhe Aa e ° eet 
BF is OD fa Cbd ELM Me? O58 bison et BWP Ss #4 1 , bs ta see ¢ pris Py ’ ‘ oe Dy 
Set Met 8a we Spe dg iy "Fell wmraiayy i Py Aw tee w at) aes fs ‘ ry i . Lane eran she . =e . 
POF ws - Aenea Per 2 Ce a ara ee Age AI mdi Fog ys, da ra * 7 ‘ Vee 3 2 ; = ae : . ' ‘ ' 
rere! La 000%, F.1D Hp ah? Ot A ee ht ea SO et de ‘a, See = poe a, a A . pease to ele 6 a . 
SAP SP Oe Para t Geeks 8 a KEP oe On £4 : ~ ge Sa oe 8 . + ° ‘ 
Ponta Rea SA ay AA IP TURD OO pee MPa oe, os = : or a) . . . ’ ‘ 
tire hoo pf CLO POON AD P29 ot POM GX, enc : f F * ’ rng ' 
PMT 2 2 Feit SPAN Ded Od Piaew ee od we ot = ‘ Afar mats . e se " 8 8 6 
Mad f %s Feet et. PS Ome de uty et Fic ; - ta . ‘ ‘ 
Ve hed ET +o q 2% bre gs . . May Cie nae ‘ 
$0 St al PP a ivis ed ot ™ eee. ! : ‘ ' ' . 
Ct  .  e FAD. a te ’ 7 
wate a aa oy eo Mig ' ‘ "8 ne ‘ 7 : 
Pat nds Pegi Ls ar a Pe teh ha a aA 7 aoe ' 
(4 7 a yf @* 4 oe fe miaes 18 le *, 8 é ‘ 
P23 | i - Aor ag of as FA id, a ‘. . : te : . F . 
# ons ta tifa "04 ae ae o 4, ome ‘ 
ea ee a at 2 ee oe . in os 6 . ‘oo ar i 
wt. FI. S008 2 a, Carats bes a ; ‘ Ar a ea ‘ 
SS MP ve te hn ‘Aw dt ih ae) ‘ ‘1 . 
fit le er ee ee Pe aa Ve wey tse LU s 1 z . 
Pye ey Bee se lage dees ooh Eris tae - . 
1 Dade Fayen maw eae KE! [f vs 7 . ae : . " ® 
wi : ; ‘ os 
, . 
— . ‘ oe ' * 68 
© te ee o- 
. ¢, . ‘ e ° 
fF 2 i. : ' 
en - Ld ‘ 
ce *e as 
f’s eet £ owiat 
J ° pri gr jer 
op, “PN Ad ep 
AS coh Ywar, 


” dee 
- BY were a, 
Sy. VS wey af 
HH AAT 
may 

















. WP Ne SAY ‘j 
“nam 4 eM + KG Ue re bate Wh RC et he 
“ >? “44, NTS NOR pepe > tr a ‘ 
Brey 7 WORA KOS ~s 483 NRA wha 
pokalhe Sabot ols Te Oe eo wee $ = byes 
a 8 -*K AS we a 





ve Poly & _ uss 
2 Py bike ote SAY e RIG YAK, 2 he 
tie th tS SSPIENE NA key mY me 
$F tomes hy FO "Py Aetute San! "VAL SN ty 

SRA e sD OHA ORE 4 TS Si LAN, ea LUE ON 
ee ee Ba ns aad Sw NTS. Sa Ron Zk, ey ha AVA IM Oe: 
pth to te ath ee ck OR fa Meets te ate, WW RRA er ae ae . 
MORE Sa > EAR VON yy Sa Pete teh aT TES RA ae 
“MMA BMRA ak, he Th MeV MG a a RR say's eee 
CRUE ON se ee ee SM be te eee Nh Ve ae ha 

Ae US A OHA @ i 8 Wau eG %.8-WR OS THAD 
WAM, e “Sta ENS IS oe Vo? a8 Wwe i Je ee he ee OY RUBBUT To WNL ars % 

oe tae, tate VERS YOR WY VES Was “HAGUE dean Wehha Saga’ 

Naren @ aS US howe ey ONS “SLA pli Shs ie he SGV GTN RAN Y eo 
USER ANNA TW ANKE VR DA oe We, ir Soe a ate ‘we 
mE ome” Ren ey i 








TS: Nese 

Vea WANG 8 

‘A, 2% WS 
a hy ry 















* tye.an Orie ‘ 
oe? SN NE BE 21 Uwe Orers se ee § 
APU SNe FG 8) Yl a oy oy he $7 W's Neti ate 
SON! TAS. bi dhtate tata hy bts a et Apr AB” 
eSMehe. .& WANG Wie fi le OG eA ks 

























































































































































.é4 1% . 
\ * or y 4 oo 
WA e wi #UVUPe ey 4 ’ 
Lae dd be Ta SS : Sra W Uy’ 5 : bas NE bes an 
JAR AS, TEUREA CC LHe BEL hb PS ONS 8 wy bh Oe ee ’ TUAW LN « TOOTS Qacet a. SeVidVuevayey y 
rt 4b eaek ee LL A Se 6 VON ee SCORE Gt. are beeen * uray § WUD OTL ott ey 5 La | UrTeseye seg a oN 
iat — Tas waa cae Set yates SO eT Py ee a thee Rise Mh Te dh Tit th CPOs Nard 4 ry eo OW PSS ets SEN Gig 3 
~ 1+ ah Hi oe ae " NSN ATH. Sth A WY SWAT Te Re Fy TUR as ” we WVIw~ EY Os ek 
btpsheltchen th Path theta teh ht, he TIO TUELA VLE we, ae ea ‘Tae wae net hr a 4 rie aus Reoeer We © Verney es ie eet 
Lilet itn SONA ENA Ve we awe ee."v AA ta ES PTE aa: Oh ba Dk A Gey HOV Vek 0 err Wee 
ble de nde th he Y SL Qe tay GOT Ste Ew, Sia Bee SUNY VALS LA VI EULA OO RLM eve a Oe i ‘ Fi 
elas ln tk | pete Uh OR 'C.e Vey N'SRl Su Ore ay VU Qewlew® 66 AD rey. YN be & LUwone ye re 8 J 
MAME Sate BEM Vee wine 3 Pay HA ® CRETE NE Hy DT Vey ard 2: % era ihadus a*e y MOA one afc tent 
SVN EO fare ee MIRA Te Ge elk be ee ee UC te @ haw tye wb aheararens v bevy ’ i Diy Tee pr ae greteene 
WED Ati bet Oe NS a eh 04 ont MOWEVULA ORS ede TUUNCS Dts caning pir iath STB A Si Jo ee Us ier a sere, Kok 
PEK a eee te i) ee REEVE CUA NA ew eS baad Re a i ae ke : , poe. PO ee Fathi ers ee a 4 
AOA wee & 4 e bt Ah Na a UNITY © ye FWD Coewea NY! WA ‘ RPS rr COV 9 Ur’ VO Grae Varese ' Peorvge a or ) 
My 53 er Gen BO VH MWY DIL Y ole WRC oo wiper yy N90 Biya mn ome eae te. aN Ta LOL ee ee hh 4 > » SUNI bes Heese 6 toe 
TA PW ay ay SRW P ea gawasn 12 & My Leeann SOPH Berke A A > he vO) he bar SO SSN ARCO G ees iia e% 
Lom aes Ce ae a 0.8 “Weta teen Om OU@ ANG. ov hy ‘onsbaa . cele aeien ig _ 
7 ts y ON! FU CA mee \ fs hed, ey or we L 8 tee sme US VC arean tHe eeoe 
r ere ey eee VAP a, Pee eee Pg A, ad rye od ey ioe eterna ea rae 
bhtetn ted Rule ehh ke Sane * % *euey “ANU ewe Oh VOW eD ie Kmeet cate a i ee ‘ as 
CRA Min & Mh Atle Ye eee GNA E ON ’ WG UMA Ewe WV RGT Log ay PMCARCE NC Vane hes Z P ae 
fete Dye atte ae Lok : * * x | oe ee at a. “ & a> ef a tte 1 La 
>t: Phe i a H's me BS! h ag ; as nee 
way RA BEE TY SUT Se Ue] age BA ES AOS ais oe } waa piers vars 
SSP yc Skat BOHR ot : ~~ : RF 0 gre 4 a ao 
* i ho has . . 
0 Nan ‘4 Sealey “A? ta mse y bene eer : ue i. See! ce , vans < 
eth LR OLE Ey Saker acy Ke ht ‘ a us 
ihe AS eaten Seton? We, odie pera bbe : Se reer ara een 
SOR ee RY CVBM Va ‘ Tak ea ' 
be, Hs be dats) URS ce hie Ge we ‘TAM Oe 9a. , CR eve yt hey 1 8b UVa ESe wv she 
ot Legit Ae Brews bales St, Vie aeme 40% t 1) 4 VU ee msg ety a 
ee a tale meek kok beta thie te ht PL WWW DT OR Y: y : AT re ary ee ea eT ewsahiigyas a or 
ee YU eee oy cea rege OW UGA . ee ate Rad Mego tle 
a WUE WD Cree We He UL aa y 
“ Peet at 





























‘ x 
we Bhan eoes "wv foe Ca J tbe 
Lh re Oe ee Oe ee y Rey, Yee [oars ' 4 4 
Y Si WR When a sz ® 
vem 8 + Vey Ft Sal wes Dre | Te we Nee 
2 OA BU aH, ta Wee FU Ft eb es any . ® ve 
4.4 eat var COR sues ve vot 
heh boa arte de aed CHT ELE SL, Eee Wat tar toe t oe ee | 
ee eo a | SUR eH Hes sta, fees Ce | 
: pte tb UL": AA HAY CPO Ore eet HY va, ¢ i Oe a 
Pe Ur 44 Shaheen 8 4. VVC tne ahh omy PNW CR i ay) oy ek 
Abi Me Ziet On tl Y ee O°) Bg ig airere { ofS CALELO WR Ob Oe b CWA CLV hE ys ee ie ek ur ne | 
SEU Cee ye URI OVE wD SO we Yee DAL RCUBMELE eas Cee eves gnay CCC gaeedte. a tere 
A WEY ONL He & wh | ‘ he eke ho 6 ie ree . ree oevaee in, os ft * Rive any 
LARA ARAL AO) Lae MD QO Viret A Ve MV COUR NG kA Oe Se RU ety Hebresweh coe ¢ e104 
OS ehh iew.y Ware hee DE, VewR OY re ache We 88m we ent het eda le. COMO Tt) 
even rellersinnertnt VHee Wee eeu ek ae Be 
A i 8 a a c ew 
8079 wee ae Chae ce Paap tee A EI 
@ Ox ae Q: 







Ce Tayo 16 





] “OHH OB, Bd . 
Pett, ahaa ok 4.54. Hh. 
lw ret t @o% \' e&b 
. “. 

a 





1 

e TUNA te te ae | ory ’ “! 
ide ie hia 

‘ 












id ate 4 ORG Tete 
8T7VE Rey tah Yee 
Padédtes dle tes ht 
Pe dip mp amy’ J 
Pata tsa Ue he 
Pirewegyg 
a ede 
aepee SPU Wise 
ean 
id ia 


meneeee ican ye 
“Atte 1th: 1a -| 

8 Oh BA ehh Wee % 
Verve tes ‘ 












‘try Ptus 
é P ie he *@ ber 

‘ 7 VY atd 
LATA! ¢, : 
Ae ON ‘ 













4 wh, rere, ‘ R CN eae 
i" eee G1, ‘ 
‘A ict emete wees yr 





>. teee 
ROO @ O5,% bem, 8.6. On 


— 


a Oe 


